-- Logs begin at Sun 2022-08-21 00:10:34 UTC, end at Sun 2022-08-21 01:22:32 UTC. -- Aug 21 00:50:16.161834 dv-osbrick-master-4-iscsi systemd[1]: Starting Devstack devstack@keystone.service... Aug 21 00:50:16.174133 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: [uWSGI] getting INI configuration from /etc/keystone/keystone-uwsgi-public.ini Aug 21 00:50:16.177252 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: *** Starting uWSGI 2.0.18-debian (64bit) on [Sun Aug 21 00:50:16 2022] *** Aug 21 00:50:16.177252 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Aug 21 00:50:16.177252 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Aug 21 00:50:16.177252 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: nodename: dv-osbrick-master-4-iscsi Aug 21 00:50:16.177252 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: machine: x86_64 Aug 21 00:50:16.177252 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: clock source: unix Aug 21 00:50:16.177252 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: pcre jit disabled Aug 21 00:50:16.177252 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: detected number of CPU cores: 4 Aug 21 00:50:16.177252 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: current working directory: / Aug 21 00:50:16.177252 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: detected binary path: /usr/bin/uwsgi-core Aug 21 00:50:16.177252 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: your processes number limit is 47680 Aug 21 00:50:16.177950 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: your memory page size is 4096 bytes Aug 21 00:50:16.177950 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: detected max file descriptor number: 2048 Aug 21 00:50:16.177950 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: lock engine: pthread robust mutexes Aug 21 00:50:16.177950 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: thunder lock: enabled Aug 21 00:50:16.177950 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/keystone-wsgi-public.socket fd 4 Aug 21 00:50:16.177950 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Aug 21 00:50:16.218665 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: Python main interpreter initialized at 0x5616269fe9c0 Aug 21 00:50:16.218779 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: python threads support enabled Aug 21 00:50:16.218779 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: your server socket listen backlog is limited to 100 connections Aug 21 00:50:16.218779 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: your mercy for graceful operations on workers is 90 seconds Aug 21 00:50:16.219013 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: mapped 403077 bytes (393 KB) for 2 cores Aug 21 00:50:16.219124 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: *** Operational MODE: preforking *** Aug 21 00:50:16.219423 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: *** uWSGI is running in multiple interpreter mode *** Aug 21 00:50:16.219423 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: spawned uWSGI master process (pid: 81564) Aug 21 00:50:16.219619 dv-osbrick-master-4-iscsi systemd[1]: Started Devstack devstack@keystone.service. Aug 21 00:50:16.224907 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: spawned uWSGI worker 1 (pid: 81577, cores: 1) Aug 21 00:50:16.224907 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: spawned uWSGI worker 2 (pid: 81578, cores: 1) Aug 21 00:50:16.224907 dv-osbrick-master-4-iscsi devstack@keystone.service[81564]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Aug 21 00:50:20.523804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 21 00:50:20.523804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: from cryptography.utils import int_from_bytes Aug 21 00:50:20.524658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 21 00:50:20.524658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: from cryptography.utils import int_from_bytes Aug 21 00:50:20.564410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 21 00:50:20.564410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: from cryptography.utils import int_from_bytes Aug 21 00:50:20.565166 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Aug 21 00:50:20.565166 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: from cryptography.utils import int_from_bytes Aug 21 00:50:20.575340 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 21 00:50:20.575537 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 21 00:50:20.575726 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] command line args: [] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 21 00:50:20.576027 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 21 00:50:20.576164 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ================================================================================ {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 21 00:50:20.576453 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] admin_token = **** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.576710 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] config_dir = [] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.576869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.577078 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] config_source = [] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.577233 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] debug = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.577449 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.577860 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.578000 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.578264 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.578515 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.578766 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] list_limit = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.578957 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] log_config_append = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.579137 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.579273 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] log_dir = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.579459 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] log_file = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.579692 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.579943 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.580220 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.580440 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.580612 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.580786 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.581034 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.581304 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.581546 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.581781 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.582016 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.582254 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.582484 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.582734 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.583013 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.583544 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.583730 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] publish_errors = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.583969 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.584200 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.584376 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.584628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.584864 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.585125 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] standard_threads = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.585360 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.585613 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.585787 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.585973 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] use_journal = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.586153 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] use_json = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.586324 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] use_stderr = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.586507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] use_syslog = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.586738 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.587002 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.587244 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.587515 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.587759 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.588011 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.588258 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.588517 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.588764 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.589013 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.589289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.589544 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.589782 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.590091 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.590330 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.590584 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.590832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.591070 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.591329 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.591587 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.591835 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.592075 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.592333 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.592598 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.592853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.593130 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.593372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.593607 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.593838 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.594074 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.594327 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.594578 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.594806 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.595043 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.595291 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.595543 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.595789 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.596056 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.596290 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.596529 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.596768 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.597002 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.597264 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.597494 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.597728 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.597968 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.598223 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.598455 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.598699 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.598932 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.599176 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.599413 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.599664 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.599910 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.600139 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.600373 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.600609 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.600847 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.601111 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.601346 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.601599 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.601837 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.602088 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.602322 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.602584 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.602821 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.603064 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.603309 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.603554 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.603828 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.604073 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.604326 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.604573 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.604810 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.605062 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.605305 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.605583 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.605825 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.606065 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.606312 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.606553 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.606793 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.607031 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.607273 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.607556 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.607772 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.608024 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.608269 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.608510 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.608770 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.609011 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.609276 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.609516 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.609751 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.609988 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.610223 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.610464 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.610700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.610944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.611183 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.611436 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.611677 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.611947 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.612211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.612459 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.612697 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] auth.external = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.612934 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.613270 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.613509 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.613746 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] auth.password = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.613982 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] auth.token = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.614227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.614467 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.614720 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.614957 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.615212 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.615465 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.615700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.615937 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] credential.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.616188 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.616442 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.616694 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.616936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.617207 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.617447 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.617704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.617962 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.618204 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.618461 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.618767 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.619027 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.619292 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.619539 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.619800 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.620039 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] federation.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.620279 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.620533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.620791 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.621024 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.621352 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.621599 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.621825 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Aug 21 00:50:20.621972 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.622111 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] Configuration options gathered from: {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Aug 21 00:50:20.622245 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.622380 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] command line args: [] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Aug 21 00:50:20.622512 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.622651 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.622777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] config files: ['/etc/keystone/keystone.conf'] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Aug 21 00:50:20.622777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ================================================================================ {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Aug 21 00:50:20.623047 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.623181 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.624713 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] admin_token = **** {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.624905 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.624905 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.625295 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] config_dir = [] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.625412 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.625585 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] config_file = ['/etc/keystone/keystone.conf'] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.625707 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.625829 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] config_source = [] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.626243 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.626379 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] debug = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.626625 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.626742 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'dogpile=INFO', 'routes=INFO'] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.626951 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.627067 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] default_publisher_id = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.627208 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.627331 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] insecure_debug = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.627525 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.627658 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] instance_format = [instance: %(uuid)s] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.627831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.627954 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.628089 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.628218 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] list_limit = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.628339 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.628462 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] log_config_append = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.628462 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.628755 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.628883 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] log_dir = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.629014 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.629156 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] log_file = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.629258 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.629365 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] log_rotate_interval = 1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.629486 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.629617 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] log_rotate_interval_type = days {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.629763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.629880 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] log_rotation_type = none {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.630005 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.630005 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.630282 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.630282 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.630532 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.630645 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.630818 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.630818 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.631098 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.631231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.631354 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.631473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.631594 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] max_logfile_count = 30 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.631724 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.631832 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] max_logfile_size_mb = 200 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.631971 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.632102 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] max_param_size = 64 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.632213 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.632329 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] max_project_tree_depth = 5 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.632440 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.632552 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] max_token_size = 16384 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.632688 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.632806 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] notification_format = cadf {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.632915 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.633026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] notification_opt_out = ['identity.authenticate.success', 'identity.authenticate.pending', 'identity.authenticate.failed'] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.633231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.633231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.633485 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] public_endpoint = http://10.222.0.49/identity {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.633597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.633723 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] publish_errors = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.633835 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.633957 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] pydev_debug_host = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.634079 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.634191 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] pydev_debug_port = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.634300 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.634412 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] rate_limit_burst = 0 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.634525 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.634525 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.634742 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] rate_limit_except_level = CRITICAL {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.634853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.634964 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] rate_limit_interval = 0 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.635075 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.635186 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] standard_threads = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.635308 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.635423 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] strict_password_check = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.635543 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.635652 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] syslog_log_facility = LOG_USER {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.635762 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.635872 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] use_eventlog = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.636064 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.636184 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] use_journal = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.636184 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] use_json = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.636399 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.636509 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] use_stderr = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.636618 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.636783 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] use_syslog = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.636911 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.637029 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] watch_log_file = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Aug 21 00:50:20.637180 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.637290 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_concurrency.disable_process_locking = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.637403 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.637513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_concurrency.lock_path = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.637635 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.637753 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] profiler.connection_string = messaging:// {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.637882 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.637991 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] profiler.enabled = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.638103 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.638213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] profiler.es_doc_type = notification {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.638336 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.638446 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] profiler.es_scroll_size = 10000 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.638555 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.638670 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] profiler.es_scroll_time = 2m {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.638781 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.638890 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] profiler.filter_error_trace = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.639012 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.639120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] profiler.hmac_keys = SECRET_KEY {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.639231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.639343 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] profiler.sentinel_service_name = mymaster {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.639485 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.639605 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] profiler.socket_timeout = 0.1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.639716 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.639830 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] profiler.trace_sqlalchemy = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.639951 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.640071 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.640071 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.640290 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.640290 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.640505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_process_name = {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.640626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.640738 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.640738 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.640961 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.640961 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.641202 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.641327 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.641441 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] audit.namespace = openstack {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.641570 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.641686 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_policy.enforce_new_defaults = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.641806 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.641917 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_policy.enforce_scope = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.642044 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.642154 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_policy.policy_default_rule = default {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.642265 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.642378 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.642489 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.642489 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.642715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_policy.policy_file = policy.yaml {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.642827 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.642938 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.643059 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.643169 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.643295 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.643418 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.643528 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.643639 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.643750 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.643861 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.643971 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.644094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.admin_password = **** {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.644204 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.644315 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.admin_tenant_name = admin {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.644426 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.644426 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.644635 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.admin_token = **** {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.644758 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.644872 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.admin_user = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.644988 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.645128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.auth_admin_prefix = {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.645252 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.645371 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.auth_host = 127.0.0.1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.645502 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.645612 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.auth_port = 35357 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.645725 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.645844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.auth_protocol = https {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.645954 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.646066 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.auth_section = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.646187 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] resource.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.646309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.auth_type = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.646436 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.646436 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.646646 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.auth_uri = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.646770 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.646880 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.auth_version = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.646993 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.647108 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.cache = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.647220 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.647332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.cafile = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.647464 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.647574 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.certfile = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.647686 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.647809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.delay_auth_decision = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.648085 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.648202 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.enforce_token_bind = permissive {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.648332 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.648462 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.http_connect_timeout = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.648570 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] role.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.648683 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.http_request_max_retries = 3 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.648814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] role.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.648929 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.identity_uri = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.649142 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.649276 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.include_service_catalog = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.649387 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.649502 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.insecure = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.649614 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.649727 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.interface = internal {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.649943 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.650061 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.keyfile = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.650180 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.650293 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.650405 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.650517 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.650640 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.650751 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.650874 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.650985 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.651097 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.651207 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.651330 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.651447 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.memcache_secret_key = **** {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.651565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.651565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.651799 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.memcache_security_strategy = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.651908 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.652033 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.652145 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.652270 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.memcached_servers = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.652270 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.region_name = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.652528 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.652639 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles = ['service'] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.652769 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.652878 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.service_token_roles_required = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.652994 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.653131 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.service_type = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.653241 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.653349 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.token_cache_time = 300 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.653486 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.653596 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] keystone_authtoken.www_authenticate_uri = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.653712 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.653712 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.653927 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.backend = dogpile.cache.memcached {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.654041 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.654170 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.backend_argument = **** {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.654280 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.654394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.config_prefix = cache.oslo {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.654511 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.654644 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.dead_timeout = 60.0 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.654758 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.654887 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.debug_cache_backend = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.655004 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.655120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.enable_retry_client = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.655244 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.655358 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.enable_socket_keepalive = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.655473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.655608 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.enabled = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.655608 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.expiration_time = 600 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.655820 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.655933 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.hashclient_retry_attempts = 2 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.656049 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.656049 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.656283 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.hashclient_retry_delay = 1.0 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.656400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.656526 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.memcache_dead_retry = 300 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.656651 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.656771 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.656898 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] token.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.657035 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.657177 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.657296 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.memcache_pool_maxsize = 10 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.657414 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.657531 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.memcache_pool_unused_timeout = 60 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.657655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.657796 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.memcache_servers = ['localhost:11211'] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.657908 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.658018 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.memcache_socket_timeout = 1.0 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.658152 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.658269 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.proxies = [] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.658405 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.658525 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.retry_attempts = 2 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.658646 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.658646 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.658858 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.retry_delay = 0.0 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.658975 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.659115 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.socket_keepalive_count = 1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.659232 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.659352 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.socket_keepalive_idle = 1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.659472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.659590 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.socket_keepalive_interval = 1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.659715 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.659844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.tls_allowed_ciphers = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.659969 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.660097 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.tls_cafile = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.660216 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.660335 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.tls_certfile = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.660453 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.660581 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.tls_enabled = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.660697 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.660825 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] cache.tls_keyfile = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.660941 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.661088 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] application_credential.cache_time = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.661212 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.connection = **** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.661358 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] application_credential.caching = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.661491 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.661616 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] application_credential.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.661733 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.661864 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] application_credential.user_limit = -1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.661979 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.662097 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] assignment.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.662215 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.662345 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] assignment.prohibited_implied_role = ['admin'] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.662462 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.662579 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] auth.application_credential = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.662696 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.662814 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] auth.external = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.662932 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.663067 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] auth.mapped = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.663181 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.663307 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] auth.methods = ['external', 'password', 'token', 'oauth1', 'mapped', 'application_credential'] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.663434 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.663550 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] auth.oauth1 = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.663667 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.663795 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] auth.password = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.663910 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.664028 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] auth.token = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.664147 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.664266 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] catalog.cache_time = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.664401 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.664535 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] catalog.caching = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.664652 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.664788 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] catalog.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.664903 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.665021 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] catalog.list_limit = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.665255 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.665390 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] catalog.template_file = default_catalog.templates {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.665500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.665622 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] credential.auth_ttl = 15 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.665745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.665864 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] credential.cache_time = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.665992 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81577) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 21 00:50:20.666112 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] credential.caching = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.666112 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] credential.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.666112 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] credential.key_repository = /etc/keystone/credential-keys/ {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.666112 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] credential.provider = fernet {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.666112 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] credential.user_limit = -1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.666112 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] domain_config.cache_time = 300 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.666112 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] domain_config.caching = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.666855 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] domain_config.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.666855 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] endpoint_filter.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.666855 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] endpoint_filter.return_all_endpoints_if_no_filter = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.667170 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] endpoint_policy.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.667301 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] eventlet_server.admin_bind_host = 0.0.0.0 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.667508 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] eventlet_server.admin_port = 35357 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.667837 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] eventlet_server.public_bind_host = 0.0.0.0 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.668135 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] eventlet_server.public_port = 5000 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.668431 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] federation.assertion_prefix = {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.668703 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] federation.caching = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.668946 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] federation.default_authorization_ttl = 0 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.669269 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] federation.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.669693 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] federation.federated_domain_name = Federated {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.669815 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] federation.remote_id_attribute = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.670083 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] federation.sso_callback_template = /etc/keystone/sso_callback_template.html {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.670376 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] federation.trusted_dashboard = [] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.670672 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] fernet_receipts.key_repository = /etc/keystone/fernet-keys/ {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.670913 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] fernet_receipts.max_active_keys = 3 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.671210 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] fernet_tokens.key_repository = /etc/keystone/fernet-keys/ {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.674194 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] fernet_tokens.max_active_keys = 3 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.674194 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.cache_time = 600 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.674194 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.caching = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.674194 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.default_domain_id = default {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.674194 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.domain_config_dir = /etc/keystone/domains {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.674194 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.domain_configurations_from_database = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.674194 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.domain_specific_drivers_enabled = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.674194 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.674194 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.list_limit = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.674832 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.max_password_length = 4096 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.674832 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.password_hash_algorithm = bcrypt {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.674832 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.password_hash_rounds = 4 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.674832 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.salt_bytesize = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.675033 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.scrypt_block_size = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.675275 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] identity.scrypt_parallelism = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.675557 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] identity_mapping.backward_compatible_ids = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.675810 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] identity_mapping.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.676129 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] identity_mapping.generator = sha256 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.676430 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] jwt_tokens.jws_private_key_repository = /etc/keystone/jws-keys/private {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.676743 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] jwt_tokens.jws_public_key_repository = /etc/keystone/jws-keys/public {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.677027 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.alias_dereferencing = default {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.677333 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.auth_pool_connection_lifetime = 60 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.677536 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.auth_pool_size = 100 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.677801 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.chase_referrals = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.678067 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.connection_timeout = -1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.678312 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.debug_level = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.678551 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.group_ad_nesting = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.678828 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.group_additional_attribute_mapping = [] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.679122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.group_attribute_ignore = [] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.679430 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.group_desc_attribute = description {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.679669 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.group_filter = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.679946 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.group_id_attribute = cn {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.680228 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.group_member_attribute = member {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.680493 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.group_members_are_ids = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.680836 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.group_name_attribute = ou {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.681104 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.group_objectclass = groupOfNames {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.681373 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.group_tree_dn = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.681655 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.page_size = 0 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.681951 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.password = **** {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.682227 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.pool_connection_lifetime = 600 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.682506 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.pool_connection_timeout = -1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.682769 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.pool_retry_delay = 0.1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.683071 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.pool_retry_max = 3 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.683350 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.pool_size = 10 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.683720 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.query_scope = one {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.683975 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.suffix = cn=example,cn=com {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.684212 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.tls_cacertdir = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.684449 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.tls_cacertfile = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.684701 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.tls_req_cert = demand {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.684955 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.url = ldap://localhost {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.685220 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.use_auth_pool = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.685460 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.use_pool = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.685699 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.use_tls = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.685935 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.686180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_additional_attribute_mapping = [] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.686444 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_attribute_ignore = ['default_project_id'] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.686678 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_default_project_id_attribute = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.686927 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_description_attribute = description {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.687181 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_enabled_attribute = enabled {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.687430 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_enabled_default = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.687667 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_enabled_emulation = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.687900 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_enabled_emulation_dn = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.688160 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_enabled_emulation_use_group_config = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.688438 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_enabled_invert = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.688936 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_enabled_mask = 0 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.689230 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_filter = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.689527 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_id_attribute = cn {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.689809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_mail_attribute = mail {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.690099 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_name_attribute = sn {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.690415 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_objectclass = inetOrgPerson {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.690671 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_pass_attribute = userPassword {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.690909 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ldap.user_tree_dn = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.691201 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] memcache.dead_retry = 300 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.691445 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] memcache.pool_connection_get_timeout = 10 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.691720 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] memcache.pool_maxsize = 10 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.692032 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] memcache.pool_unused_timeout = 60 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.692320 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] memcache.socket_timeout = 3 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.692567 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] oauth1.access_token_duration = 86400 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.692891 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] oauth1.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.693298 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] oauth1.request_token_duration = 28800 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.693547 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] policy.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.693783 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] policy.list_limit = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.694060 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] receipt.cache_on_issue = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.694302 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] receipt.cache_time = 300 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.694596 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] receipt.caching = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.694879 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] receipt.expiration = 300 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.695132 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] receipt.provider = fernet {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.695407 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] resource.admin_project_domain_name = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.695704 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] resource.admin_project_name = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.695801 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:20.695976 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] resource.cache_time = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.696062 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:20.696237 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:20.696323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] resource.caching = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.696525 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] resource.domain_name_url_safe = off {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.696819 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] resource.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.697103 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] resource.list_limit = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.697374 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] resource.project_name_url_safe = off {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.697631 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] revoke.cache_time = 3600 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.697867 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] revoke.caching = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.698128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] revoke.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.698406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] revoke.expiration_buffer = 1800 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.698730 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] role.cache_time = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.698996 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] role.caching = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.699300 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] role.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.699575 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] role.list_limit = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.699865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.assertion_expiration_time = 3600 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.700125 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.certfile = /etc/keystone/ssl/certs/signing_cert.pem {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.700395 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.idp_contact_company = Example, Inc. {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.700780 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.idp_contact_email = support@example.com {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.701355 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.idp_contact_name = SAML Identity Provider Support {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.701519 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.idp_contact_surname = Support {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.701781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.idp_contact_telephone = +1 800 555 0100 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.702070 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.idp_contact_type = other {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.702325 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.idp_entity_id = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.702610 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.idp_lang = en {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.702886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.idp_metadata_path = /etc/keystone/saml2_idp_metadata.xml {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.703151 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.idp_organization_display_name = OpenStack SAML Identity Provider {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.703411 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.idp_organization_name = SAML Identity Provider {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.703871 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.idp_organization_url = https://example.com/ {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.704122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.idp_sso_endpoint = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.704391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.keyfile = /etc/keystone/ssl/private/signing_key.pem {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.704656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.relay_state_prefix = ss:mem: {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.704918 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] saml.xmlsec1_binary = xmlsec1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.705219 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] security_compliance.change_password_upon_first_use = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.705350 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:20.705481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] security_compliance.disable_user_account_days_inactive = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.705736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] security_compliance.lockout_duration = 10 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.706004 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] security_compliance.lockout_failure_attempts = 2 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.706247 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] security_compliance.minimum_password_age = 0 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.706491 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] security_compliance.password_expires_days = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.706736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] security_compliance.password_regex = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.706978 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] security_compliance.password_regex_description = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.707236 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] security_compliance.unique_last_password_count = 2 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.707497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] shadow_users.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.707750 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] token.allow_expired_window = 172800 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.707995 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] token.allow_rescope_scoped_token = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.708233 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] token.cache_on_issue = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.708489 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] token.cache_time = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.708731 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] token.caching = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.708955 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] token.expiration = 3600 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.709236 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] token.provider = fernet {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.709523 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] token.revoke_by_id = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.709790 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] tokenless_auth.issuer_attribute = SSL_CLIENT_I_DN {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.710051 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] tokenless_auth.protocol = x509 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.710302 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] tokenless_auth.trusted_issuer = [] {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.710557 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] totp.included_previous_windows = 1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.710815 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] trust.allow_redelegation = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.711075 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] trust.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.711316 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] trust.max_redelegation_count = 3 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.711576 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] unified_limit.cache_time = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.711806 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] unified_limit.caching = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.712066 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] unified_limit.driver = sql {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.712324 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] unified_limit.enforcement_model = flat {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.712565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] unified_limit.list_limit = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.712806 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] wsgi.debug_middleware = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.713136 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] database.backend = sqlalchemy {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.713406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] database.connection = **** {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.713656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] database.connection_debug = 0 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.713910 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] database.connection_parameters = {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.714154 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] database.connection_recycle_time = 3600 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.714402 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] database.connection_trace = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.714639 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] database.db_inc_retry_interval = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.714935 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] database.db_max_retries = 20 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.715178 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] database.db_max_retry_interval = 10 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.715419 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] database.db_retry_interval = 1 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.715671 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] database.max_overflow = 50 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.715912 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] database.max_pool_size = 5 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.716157 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] database.max_retries = 10 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.716400 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] database.mysql_enable_ndb = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.716649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] database.mysql_sql_mode = TRADITIONAL {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.716892 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] database.pool_timeout = None {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.717169 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] database.retry_interval = 10 {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.717410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] database.slave_connection = **** {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.717653 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] database.sqlite_synchronous = True {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.717893 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] database.use_db_reconnect = False {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Aug 21 00:50:20.718067 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG uwsgi [-] ******************************************************************************** {{(pid=81578) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Aug 21 00:50:20.734421 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:20.734695 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:20.743355 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:20.743585 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_user_delete_callback` subscribed to event `identity.user.disabled`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:20.743834 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.application_credential.core.Manager._delete_app_creds_on_assignment_removal` subscribed to event `identity.remove_application_credentials_for_user.internal`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:20.752698 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.assignment.core.Manager._delete_domain_assignments` subscribed to event `identity.domain.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:20.771108 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.project.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:20.771323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.catalog.core.Manager._on_project_or_endpoint_delete` subscribed to event `identity.endpoint.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:20.788922 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:20.809311 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.federation.core.Manager._cleanup_identity_provider` subscribed to event `identity.domain_deleted.internal`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:20.837171 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:20.837410 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:20.844513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._domain_deleted` subscribed to event `identity.domain_deleted.internal`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:20.844836 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.identity.core.Manager._unset_default_project` subscribed to event `identity.project.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.002919 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.003243 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.003362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.003581 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.003706 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._trust_callback` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.003842 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.003984 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._consumer_callback` subscribed to event `identity.OS-OAUTH1:consumer.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.004111 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.004245 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.004379 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._project_callback` subscribed to event `identity.project.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.004560 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.user.disabled`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.004759 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.revoke.core.Manager._user_callback` subscribed to event `identity.persist_revocation_event_for_user.internal`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.029024 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.029292 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.029485 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.029605 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.029735 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.029889 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.030014 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.030135 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.030263 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.030384 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.user.disabled`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.030519 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.030638 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.domain.disabled`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.030638 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.project.disabled`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.030869 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.receipt.provider.Manager._drop_receipt_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.042299 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.042547 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.trust.core.Manager._on_user_delete` subscribed to event `identity.user.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.055770 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.055943 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.OS-TRUST:trust.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.056080 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.056203 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.056324 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.056481 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.deleted`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.056599 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.056720 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.user.disabled`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.056839 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.056954 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.domain.disabled`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.057106 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.057231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.project.disabled`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.057348 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81578) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.057469 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [-] Callback: `keystone.token.provider.Manager._drop_token_cache` subscribed to event `identity.invalidate_token_cache.internal`. {{(pid=81577) register_event_callback /opt/stack/keystone/keystone/notifications.py:295}} Aug 21 00:50:21.074413 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.074659 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 21 00:50:21.074848 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/projects' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.074978 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.075103 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/projects' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 21 00:50:21.075227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 21 00:50:21.075407 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/domains' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.075538 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.075666 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding additional resource route (alternate) to API auth: ['/OS-FEDERATION/domains' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:433}} Aug 21 00:50:21.075784 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.075899 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/system' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.076138 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/catalog' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.076274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.076432 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens/OS-PKI/revoked' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.076546 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.076671 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth: ['/auth/tokens' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.086264 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.086505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.086662 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.086776 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.086887 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/saml2/ecp' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.087053 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/websso/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.087234 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.087359 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API auth/OS-FEDERATION: ['/auth/OS-FEDERATION/identity_providers//protocols//websso' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.094241 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.094401 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API credentials for `type` (API Prefix: ) [/credentials, /credentials/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.097190 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.097347 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API domains for `type` (API Prefix: ) [/domains, /domains/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.097503 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.097622 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.097752 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.097913 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.098035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.098207 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//config//' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.098340 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.098490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config/default' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.098608 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.098729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config//default' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.098855 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.098993 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains/config///default' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.099118 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.099274 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.099439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.099555 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//users//roles/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.099766 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.099916 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.100048 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.100173 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API domains: ['/domains//groups//roles/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.122861 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.123049 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API ec2tokens: ['/ec2tokens' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.124326 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.124476 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API endpoints for `type` (API Prefix: ) [/endpoints, /endpoints/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.124609 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.124732 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API endpoints: ['/endpoints//OS-ENDPOINT-POLICY/policy' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.129617 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.129789 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API groups for `type` (API Prefix: ) [/groups, /groups/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.129920 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.130046 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.130168 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.130289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API groups: ['/groups//users/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.136457 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.136617 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API limits for `type` (API Prefix: ) [/limits, /limits/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.136742 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.136865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API limits: ['/limits/model' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.140868 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.141033 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-EP-FILTER for `type` (API Prefix: /OS-EP-FILTER) [/endpoint_groups, /endpoint_groups/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.141196 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.141322 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoints//projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.141451 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.141589 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.141713 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.141849 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoints' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.141973 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.142137 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/projects//endpoint_groups' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.142254 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.142426 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//endpoints' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.142563 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.142715 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.142832 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.142987 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-EP-FILTER: ['/endpoint_groups//projects/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.160476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.160749 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.160911 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/saml2/metadata' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.161032 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-FEDERATION: ['/identity_providers//protocols//auth' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.164655 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.164989 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API identity_providers for `type` (API Prefix: /OS-FEDERATION) [/identity_providers, /identity_providers/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.167902 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.168255 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.168404 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.168539 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API protocols: ['/OS-FEDERATION/identity_providers//protocols' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.172455 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.172801 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API mappings for `type` (API Prefix: /OS-FEDERATION) [/mappings, /mappings/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.175649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.176165 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API service_providers for `type` (API Prefix: /OS-FEDERATION) [/service_providers, /service_providers/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.178957 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.179269 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.179419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles//inherited_to_projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.179577 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.179697 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//groups//roles/inherited_to_projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.179831 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.179950 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles//inherited_to_projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.180077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.180212 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/domains//users//roles/inherited_to_projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.180329 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.180452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//users//roles//inherited_to_projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.180739 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-INHERIT: ['/projects//groups//roles//inherited_to_projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.196269 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.196565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.196720 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API OS-OAUTH1 for `type` (API Prefix: /OS-OAUTH1) [/consumers, /consumers/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.196854 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.196981 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/request_token' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.197131 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.197255 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/access_token' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.197550 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-OAUTH1: ['/authorize/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.204007 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.204495 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API events: ['/events' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.205582 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.205865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.206130 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/ca' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.206343 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API OS-SIMPLE-CERT: ['/OS-SIMPLE-CERT/certificates' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.208517 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.208818 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.209004 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API policy for `type` (API Prefix: ) [/policies, /policies/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.209165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.209306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.209420 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.209611 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/endpoints/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.209730 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.209911 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.210258 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API policy: ['/policies//OS-ENDPOINT-POLICY/services//regions/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.221492 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.221770 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.222056 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.222213 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API projects for `type` (API Prefix: ) [/projects, /projects/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.222330 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.222471 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.222592 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.222721 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//tags/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.222846 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.222969 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.223123 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.223242 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//users//roles' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.223483 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.223780 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API projects: ['/projects//groups//roles' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.238716 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.239411 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API regions for `type` (API Prefix: ) [/regions, /regions/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.241814 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.242517 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API registered_limit for `type` (API Prefix: ) [/registered_limits, /registered_limits/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.244728 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.245463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_assignments: ['/role_assignments' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.246246 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.246978 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API role_inferences: ['/role_inferences' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.247741 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.248026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.248332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.248482 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API roles for `type` (API Prefix: ) [/roles, /roles/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.248784 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.249122 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API roles: ['/roles//implies/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.255121 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.255932 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API s3tokens: ['/s3tokens' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.256594 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.257424 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API services for `type` (API Prefix: ) [/services, /services/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.259611 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.259893 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.260206 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.260323 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.260475 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.260672 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/users//roles/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.260966 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.261281 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API system: ['/system/groups//roles/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.268483 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.268777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.269105 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.269310 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API trusts for `type` (API Prefix: /OS-TRUST) [/trusts, /trusts/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.269612 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.269900 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API trusts: ['/trusts//roles/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.275966 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81578) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.276257 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.276550 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.276821 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding standard routes to API users for `type` (API Prefix: ) [/users, /users/] {{(pid=81577) _add_resources /opt/stack/keystone/keystone/server/flask/common.py:343}} Aug 21 00:50:21.276952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.277101 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.277222 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//password' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.277424 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.277560 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//groups' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.277719 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.277887 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//projects' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.278012 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.278134 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.278252 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.278371 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//credentials/OS-EC2/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.278512 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.278632 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.278792 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.278922 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.279101 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.279222 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.279342 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.279461 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//OS-OAUTH1/access_tokens//roles/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.279585 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81578) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.279716 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.279884 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//application_credentials/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.280172 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.280446 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.common [-] Adding resource routes to API users: ['/users//access_rules/' {}] {{(pid=81577) _add_mapped_resources /opt/stack/keystone/keystone/server/flask/common.py:417}} Aug 21 00:50:21.314023 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5616269fe9c0 pid: 81578 (default app) Aug 21 00:50:21.315072 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x5616269fe9c0 pid: 81577 (default app) Aug 21 00:50:21.318100 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f00102-4259-4bef-835c-8c32d77a56e4 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:21.318371 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f00102-4259-4bef-835c-8c32d77a56e4 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:21.318687 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51f00102-4259-4bef-835c-8c32d77a56e4 None None] PATH_INFO: `/v3` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:21.323475 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 1/1] 10.222.0.49 () {50 vars in 791 bytes} [Sun Aug 21 00:50:21 2022] GET /identity/v3/ => generated 255 bytes in 9 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:27.959018 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb026c-421e-44b3-9abe-9c71617ab762 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:27.959658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb026c-421e-44b3-9abe-9c71617ab762 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:27.959658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb026c-421e-44b3-9abe-9c71617ab762 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:27.964043 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 1/2] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:50:27 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:50:27.971870 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9254532-83ab-4f5d-ba3a-cd9b9c741141 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:27.972467 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9254532-83ab-4f5d-ba3a-cd9b9c741141 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:27.972467 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9254532-83ab-4f5d-ba3a-cd9b9c741141 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:28.044409 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: INFO dbcounter [None req-c9254532-83ab-4f5d-ba3a-cd9b9c741141 None None] Registered counter for database keystone Aug 21 00:50:28.065705 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG oslo_db.sqlalchemy.engines [None req-c9254532-83ab-4f5d-ba3a-cd9b9c741141 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81578) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 21 00:50:28.073675 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writer thread running {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 21 00:50:28.265454 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG passlib.handlers.bcrypt [None req-c9254532-83ab-4f5d-ba3a-cd9b9c741141 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81578) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 21 00:50:28.265873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG passlib.handlers.bcrypt [None req-c9254532-83ab-4f5d-ba3a-cd9b9c741141 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81578) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 21 00:50:28.322477 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-c9254532-83ab-4f5d-ba3a-cd9b9c741141 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:28.324205 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c9254532-83ab-4f5d-ba3a-cd9b9c741141 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:28.462219 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 2/3] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:27 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 491 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 21 00:50:28.928848 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb026c-421e-44b3-9abe-9c71617ab762 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:28.997979 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: INFO dbcounter [None req-3ceb026c-421e-44b3-9abe-9c71617ab762 None None] Registered counter for database keystone Aug 21 00:50:29.020244 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG oslo_db.sqlalchemy.engines [None req-3ceb026c-421e-44b3-9abe-9c71617ab762 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=81577) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Aug 21 00:50:29.027773 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writer thread running {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Aug 21 00:50:29.148027 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb026c-421e-44b3-9abe-9c71617ab762 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:29.152792 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f067ae4f-1ffc-4a36-9671-8a1ff0c9caaf admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:29.153473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067ae4f-1ffc-4a36-9671-8a1ff0c9caaf admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:29.153754 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067ae4f-1ffc-4a36-9671-8a1ff0c9caaf admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:29.154043 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f067ae4f-1ffc-4a36-9671-8a1ff0c9caaf admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:29.164421 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067ae4f-1ffc-4a36-9671-8a1ff0c9caaf admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:29.237538 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: WARNING keystone.common.rbac_enforcer.enforcer [None req-f067ae4f-1ffc-4a36-9671-8a1ff0c9caaf admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 21 00:50:29.237884 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f067ae4f-1ffc-4a36-9671-8a1ff0c9caaf admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:29.248598 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 2/4] 10.222.0.49 () {58 vars in 1324 bytes} [Sun Aug 21 00:50:28 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 320 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 00:50:29.255157 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9254532-83ab-4f5d-ba3a-cd9b9c741141 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:29.270931 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9254532-83ab-4f5d-ba3a-cd9b9c741141 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:29.276127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a448963-9151-4762-8b0a-0b7048a59df2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:29.277369 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a448963-9151-4762-8b0a-0b7048a59df2 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:29.277646 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a448963-9151-4762-8b0a-0b7048a59df2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:29.277910 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a448963-9151-4762-8b0a-0b7048a59df2 admin admin] PATH_INFO: `/v3/projects/ccef469c265b41be893535a3cf96c82d` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:29.279602 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a448963-9151-4762-8b0a-0b7048a59df2 admin admin] RBAC: Authorizing `identity:get_project(project_id=ccef469c265b41be893535a3cf96c82d)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:29.331771 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: WARNING keystone.common.rbac_enforcer.enforcer [None req-4a448963-9151-4762-8b0a-0b7048a59df2 admin admin] Deprecated policy rules found. Use oslopolicy-policy-generator and oslopolicy-policy-upgrade to detect and resolve deprecated policies in your configuration. Aug 21 00:50:29.332109 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a448963-9151-4762-8b0a-0b7048a59df2 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:29.336783 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 3/5] 10.222.0.49 () {56 vars in 1207 bytes} [Sun Aug 21 00:50:29 2022] GET /identity/v3/projects/ccef469c265b41be893535a3cf96c82d => generated 344 bytes in 82 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:31.224424 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbb83b-7a1b-4ee5-b769-c75519c70f8f None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:31.224869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbb83b-7a1b-4ee5-b769-c75519c70f8f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:31.224973 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2bbbb83b-7a1b-4ee5-b769-c75519c70f8f None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:31.229258 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 3/6] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:50:31 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:31.235244 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e58d4-d013-4553-bf98-603d218e1d57 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:31.235741 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e58d4-d013-4553-bf98-603d218e1d57 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:31.235741 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-179e58d4-d013-4553-bf98-603d218e1d57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:31.257603 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-179e58d4-d013-4553-bf98-603d218e1d57 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:31.259147 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-179e58d4-d013-4553-bf98-603d218e1d57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:31.267743 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 4/7] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:31 2022] POST /identity/v3/auth/tokens => generated 914 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 384 bytes (1 switches on core 0) Aug 21 00:50:31.532133 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbb83b-7a1b-4ee5-b769-c75519c70f8f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:31.546411 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2bbbb83b-7a1b-4ee5-b769-c75519c70f8f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:31.551257 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87388e6d-c37a-417c-940c-49c519c2e3f7 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:31.551873 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87388e6d-c37a-417c-940c-49c519c2e3f7 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:31.552154 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87388e6d-c37a-417c-940c-49c519c2e3f7 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:31.552432 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87388e6d-c37a-417c-940c-49c519c2e3f7 admin admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:31.560658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87388e6d-c37a-417c-940c-49c519c2e3f7 admin admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:31.562473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87388e6d-c37a-417c-940c-49c519c2e3f7 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:31.571544 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 4/8] 10.222.0.49 () {58 vars in 1324 bytes} [Sun Aug 21 00:50:31 2022] GET /identity/v3/auth/tokens => generated 914 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 00:50:31.577665 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e58d4-d013-4553-bf98-603d218e1d57 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:31.587512 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-179e58d4-d013-4553-bf98-603d218e1d57 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:31.593361 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e739f196-39f9-4e8c-9a47-1513f2623655 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:31.594009 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739f196-39f9-4e8c-9a47-1513f2623655 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:31.594292 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739f196-39f9-4e8c-9a47-1513f2623655 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:31.594562 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e739f196-39f9-4e8c-9a47-1513f2623655 admin admin] PATH_INFO: `/v3/users/bab4a9bddb7141a48bb694677f33efcc` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:31.596013 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739f196-39f9-4e8c-9a47-1513f2623655 admin admin] RBAC: Authorizing `identity:get_user(user_id=bab4a9bddb7141a48bb694677f33efcc)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:31.597917 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e739f196-39f9-4e8c-9a47-1513f2623655 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:31.599499 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 5/9] 10.222.0.49 () {56 vars in 1198 bytes} [Sun Aug 21 00:50:31 2022] GET /identity/v3/users/bab4a9bddb7141a48bb694677f33efcc => generated 247 bytes in 22 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:33.570316 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4585178-75b6-43f0-93b1-14237696c928 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:33.570854 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4585178-75b6-43f0-93b1-14237696c928 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:33.570854 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4585178-75b6-43f0-93b1-14237696c928 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:33.571981 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 5/10] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:50:33.577966 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fa108-b026-4bc7-9014-2bbd99660263 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:33.578602 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fa108-b026-4bc7-9014-2bbd99660263 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:33.578602 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5fa108-b026-4bc7-9014-2bbd99660263 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:33.601498 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-fb5fa108-b026-4bc7-9014-2bbd99660263 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:33.602730 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-fb5fa108-b026-4bc7-9014-2bbd99660263 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:33.613801 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bac03c-91d0-4877-9300-10d4c82e7ddc None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:33.614079 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bac03c-91d0-4877-9300-10d4c82e7ddc None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:33.614375 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55bac03c-91d0-4877-9300-10d4c82e7ddc None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:33.615723 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 6/11] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:50:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:33.621461 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d12ed-be7a-4a1c-b9a0-3f5bc05c3046 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:33.621705 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d12ed-be7a-4a1c-b9a0-3f5bc05c3046 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:33.622071 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e26d12ed-be7a-4a1c-b9a0-3f5bc05c3046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:33.667151 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG passlib.handlers.bcrypt [None req-e26d12ed-be7a-4a1c-b9a0-3f5bc05c3046 None None] detected 'bcrypt' backend, version '3.2.2' {{(pid=81577) _load_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:625}} Aug 21 00:50:33.667581 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG passlib.handlers.bcrypt [None req-e26d12ed-be7a-4a1c-b9a0-3f5bc05c3046 None None] 'bcrypt' backend lacks $2$ support, enabling workaround {{(pid=81577) _finalize_backend_mixin /usr/local/lib/python3.8/dist-packages/passlib/handlers/bcrypt.py:406}} Aug 21 00:50:33.695347 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 6/12] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:50:33.713711 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e26d12ed-be7a-4a1c-b9a0-3f5bc05c3046 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:33.715396 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e26d12ed-be7a-4a1c-b9a0-3f5bc05c3046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:33.833035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 7/13] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:50:33.965780 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fa108-b026-4bc7-9014-2bbd99660263 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:33.992512 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:34.082907 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5fa108-b026-4bc7-9014-2bbd99660263 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:34.104319 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d12ed-be7a-4a1c-b9a0-3f5bc05c3046 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:34.119441 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7ee63-28ef-4106-bd36-fe3509d738ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:34.120097 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7ee63-28ef-4106-bd36-fe3509d738ee None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:34.120376 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7ee63-28ef-4106-bd36-fe3509d738ee None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:34.120649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd7ee63-28ef-4106-bd36-fe3509d738ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:34.134538 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bd7ee63-28ef-4106-bd36-fe3509d738ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:50:34.143656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-8bd7ee63-28ef-4106-bd36-fe3509d738ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:50:34.143656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:50:34.143656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:50:34.143656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:50:34.143656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:50:34.143656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:50:34.143656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:50:34.143656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:50:34.143656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:50:34.143656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:50:34.143656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:50:34.143656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:50:34.143656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:50:34.143656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:50:34.143656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:50:34.143656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:50:34.145457 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:50:34.145457 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:50:34.145457 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:50:34.145457 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:50:34.145457 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:50:34.145457 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:50:34.145457 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:50:34.145457 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:50:34.145457 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:50:34.145457 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:50:34.145457 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:50:34.145457 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:50:34.145457 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:50:34.145457 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:50:34.145457 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:50:34.145457 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:50:34.147034 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:50:34.147034 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:50:34.147034 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:50:34.147034 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:50:34.147034 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:50:34.147034 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:50:34.147034 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:50:34.147034 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:50:34.147034 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:50:34.147034 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:50:34.147034 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:50:34.147034 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:50:34.147034 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 7/14] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:50:33 2022] GET /identity/v3/roles/admin => generated 83 bytes in 180 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:50:34.152946 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7ee63-28ef-4106-bd36-fe3509d738ee None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:34.215956 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e26d12ed-be7a-4a1c-b9a0-3f5bc05c3046 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:34.219359 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:34.251175 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:34.266384 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fea4d6-a4fa-460a-8bcd-4a7f89aabd1c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:34.267281 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fea4d6-a4fa-460a-8bcd-4a7f89aabd1c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:34.267563 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fea4d6-a4fa-460a-8bcd-4a7f89aabd1c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:34.267840 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4fea4d6-a4fa-460a-8bcd-4a7f89aabd1c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:34.271880 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd7ee63-28ef-4106-bd36-fe3509d738ee None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:34.306932 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc760e1-1901-40a6-988b-1b07ea186e4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:34.307541 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc760e1-1901-40a6-988b-1b07ea186e4d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:34.307818 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc760e1-1901-40a6-988b-1b07ea186e4d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:34.308082 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bc760e1-1901-40a6-988b-1b07ea186e4d None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:34.308775 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc760e1-1901-40a6-988b-1b07ea186e4d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:50:34.309107 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc760e1-1901-40a6-988b-1b07ea186e4d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:34.310519 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bc760e1-1901-40a6-988b-1b07ea186e4d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:34.323006 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 8/15] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:50:34 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:50:34.329222 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc760e1-1901-40a6-988b-1b07ea186e4d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:34.340855 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fea4d6-a4fa-460a-8bcd-4a7f89aabd1c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:34.342450 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4fea4d6-a4fa-460a-8bcd-4a7f89aabd1c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:34.441588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bc760e1-1901-40a6-988b-1b07ea186e4d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:34.453403 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 8/16] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:50:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 350 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 21 00:50:34.459214 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fea4d6-a4fa-460a-8bcd-4a7f89aabd1c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:34.462227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:34.480607 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0f1d8-4e52-41e9-a108-80471b72d5f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:34.481647 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0f1d8-4e52-41e9-a108-80471b72d5f6 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:34.482093 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0f1d8-4e52-41e9-a108-80471b72d5f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:34.482547 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ec0f1d8-4e52-41e9-a108-80471b72d5f6 None admin] PATH_INFO: `/v3/users/bab4a9bddb7141a48bb694677f33efcc` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:34.484332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0f1d8-4e52-41e9-a108-80471b72d5f6 None admin] RBAC: Authorizing `identity:get_user(user_id=bab4a9bddb7141a48bb694677f33efcc)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:34.486873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ec0f1d8-4e52-41e9-a108-80471b72d5f6 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:34.489891 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 9/17] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:50:34 2022] GET /identity/v3/users/bab4a9bddb7141a48bb694677f33efcc => generated 247 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:50:34.495498 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0f1d8-4e52-41e9-a108-80471b72d5f6 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:34.511329 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:34.577444 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4fea4d6-a4fa-460a-8bcd-4a7f89aabd1c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:34.613260 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58ba3d-5f46-470f-b9fa-e78c807d58c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:34.614261 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58ba3d-5f46-470f-b9fa-e78c807d58c5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:34.614664 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58ba3d-5f46-470f-b9fa-e78c807d58c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:34.615015 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea58ba3d-5f46-470f-b9fa-e78c807d58c5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:34.619265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ec0f1d8-4e52-41e9-a108-80471b72d5f6 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:34.634673 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58ba3d-5f46-470f-b9fa-e78c807d58c5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:34.636154 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea58ba3d-5f46-470f-b9fa-e78c807d58c5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:34.654605 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ea58ba3d-5f46-470f-b9fa-e78c807d58c5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:50:34.654605 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:50:34.654605 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:50:34.654605 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:50:34.654605 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:50:34.654605 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:50:34.654605 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:50:34.654605 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:50:34.654605 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:50:34.654605 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:50:34.654605 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:50:34.654605 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:50:34.654605 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:50:34.654605 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:50:34.654605 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:50:34.654605 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:50:34.656456 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:50:34.656456 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:50:34.656456 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:50:34.656456 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:50:34.656456 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:50:34.656456 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:50:34.656456 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:50:34.656456 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:50:34.656456 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:50:34.656456 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:50:34.656456 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:50:34.656456 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:50:34.656456 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:50:34.656456 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:50:34.656456 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:50:34.656456 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:50:34.656456 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:50:34.658336 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:50:34.658336 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:50:34.658336 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:50:34.658336 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 9/18] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:50:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:50:34.658814 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ae771-16b6-4c2f-b22d-31f20be4384d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:34.658814 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ae771-16b6-4c2f-b22d-31f20be4384d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:34.658814 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ae771-16b6-4c2f-b22d-31f20be4384d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:34.658814 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a06ae771-16b6-4c2f-b22d-31f20be4384d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:34.659336 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ae771-16b6-4c2f-b22d-31f20be4384d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:34.660330 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a06ae771-16b6-4c2f-b22d-31f20be4384d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:34.661915 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 10/19] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:50:34 2022] GET /identity/v3/domains/default => generated 199 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:50:34.663182 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58ba3d-5f46-470f-b9fa-e78c807d58c5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:34.668039 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ae771-16b6-4c2f-b22d-31f20be4384d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:34.732642 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:34.760496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:34.781956 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a06ae771-16b6-4c2f-b22d-31f20be4384d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:34.784296 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea58ba3d-5f46-470f-b9fa-e78c807d58c5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:34.819616 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-464a02ac-ecb2-4caa-8899-d3640dfe60b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:34.820403 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a02ac-ecb2-4caa-8899-d3640dfe60b5 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:34.820809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a02ac-ecb2-4caa-8899-d3640dfe60b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:34.821237 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-464a02ac-ecb2-4caa-8899-d3640dfe60b5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:34.821804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a42e0cf-426f-41fb-89fd-b30496e524ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:34.822142 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a02ac-ecb2-4caa-8899-d3640dfe60b5 None admin] RBAC: Adding query filter params (role.id=c73e9539582145ed8eedc48648b9d738, scope.domain.id=default, user.id=bab4a9bddb7141a48bb694677f33efcc) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:50:34.822415 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42e0cf-426f-41fb-89fd-b30496e524ad None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:34.822608 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a02ac-ecb2-4caa-8899-d3640dfe60b5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:34.822771 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42e0cf-426f-41fb-89fd-b30496e524ad None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:34.822919 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a42e0cf-426f-41fb-89fd-b30496e524ad None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:34.823572 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42e0cf-426f-41fb-89fd-b30496e524ad None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:50:34.823870 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42e0cf-426f-41fb-89fd-b30496e524ad None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:34.824497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-464a02ac-ecb2-4caa-8899-d3640dfe60b5 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:34.825316 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a42e0cf-426f-41fb-89fd-b30496e524ad None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:34.832423 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 11/20] 10.222.0.49 () {56 vars in 1322 bytes} [Sun Aug 21 00:50:34 2022] GET /identity/v3/role_assignments?user.id=bab4a9bddb7141a48bb694677f33efcc&scope.domain.id=default&role.id=c73e9539582145ed8eedc48648b9d738 => generated 233 bytes in 165 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:34.846649 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 10/21] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:50:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:50:36.875232 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451799e5-ffb1-4e16-aea4-789a6c99b137 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:36.875747 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451799e5-ffb1-4e16-aea4-789a6c99b137 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:36.876162 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-451799e5-ffb1-4e16-aea4-789a6c99b137 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:36.877743 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 12/22] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:50:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:36.884648 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79258a0-0fc5-4886-924c-926f76077e06 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:36.885176 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79258a0-0fc5-4886-924c-926f76077e06 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:36.885267 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a79258a0-0fc5-4886-924c-926f76077e06 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:36.914949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-a79258a0-0fc5-4886-924c-926f76077e06 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:36.916193 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a79258a0-0fc5-4886-924c-926f76077e06 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:37.022948 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 11/23] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 139 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:50:37.557098 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451799e5-ffb1-4e16-aea4-789a6c99b137 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:37.710846 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-451799e5-ffb1-4e16-aea4-789a6c99b137 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:37.763361 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c45ee-640c-4964-a5f3-5c0204e02475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:37.764036 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c45ee-640c-4964-a5f3-5c0204e02475 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:37.764383 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c45ee-640c-4964-a5f3-5c0204e02475 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:37.764657 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b4c45ee-640c-4964-a5f3-5c0204e02475 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:37.793822 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b4c45ee-640c-4964-a5f3-5c0204e02475 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:50:37.799697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-0b4c45ee-640c-4964-a5f3-5c0204e02475 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:50:37.799697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:50:37.799697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:50:37.799697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:50:37.799697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:50:37.799697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:50:37.799697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:50:37.799697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:50:37.799697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:50:37.799697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:50:37.799697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:50:37.799697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:50:37.799697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:50:37.799697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:50:37.799697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:50:37.799697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:50:37.800661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:50:37.800661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:50:37.800661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:50:37.800661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:50:37.800661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:50:37.800661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:50:37.800661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:50:37.800661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:50:37.800661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:50:37.800661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:50:37.800661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:50:37.800661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:50:37.800661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:50:37.800661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:50:37.800661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:50:37.800661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:50:37.801436 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:50:37.801436 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:50:37.801436 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:50:37.801436 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:50:37.801436 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:50:37.801436 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:50:37.801436 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:50:37.801436 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:50:37.801436 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:50:37.801436 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:50:37.801436 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:50:37.801436 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:50:37.801436 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 13/24] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:50:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 245 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:50:37.808350 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79258a0-0fc5-4886-924c-926f76077e06 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:37.876568 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:37.957078 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a79258a0-0fc5-4886-924c-926f76077e06 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:38.018012 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82450ba6-5e23-4ca6-8bc8-51a721013ccf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:38.018660 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82450ba6-5e23-4ca6-8bc8-51a721013ccf None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:38.018948 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82450ba6-5e23-4ca6-8bc8-51a721013ccf None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:38.019220 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82450ba6-5e23-4ca6-8bc8-51a721013ccf None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:38.019916 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82450ba6-5e23-4ca6-8bc8-51a721013ccf None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:50:38.020257 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82450ba6-5e23-4ca6-8bc8-51a721013ccf None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:38.021695 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82450ba6-5e23-4ca6-8bc8-51a721013ccf None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:38.035756 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 12/25] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:50:37 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:38.041840 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c45ee-640c-4964-a5f3-5c0204e02475 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:38.054452 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:38.231309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b4c45ee-640c-4964-a5f3-5c0204e02475 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:38.285807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05f6488f-c762-4a5b-afb9-a9e1c6398380 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:38.286467 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6488f-c762-4a5b-afb9-a9e1c6398380 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:38.286753 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6488f-c762-4a5b-afb9-a9e1c6398380 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:38.287031 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05f6488f-c762-4a5b-afb9-a9e1c6398380 None admin] PATH_INFO: `/v3/users/bab4a9bddb7141a48bb694677f33efcc` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:38.288275 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6488f-c762-4a5b-afb9-a9e1c6398380 None admin] RBAC: Authorizing `identity:get_user(user_id=bab4a9bddb7141a48bb694677f33efcc)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:38.289838 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05f6488f-c762-4a5b-afb9-a9e1c6398380 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:38.291799 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 14/26] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:50:38 2022] GET /identity/v3/users/bab4a9bddb7141a48bb694677f33efcc => generated 247 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:38.298095 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82450ba6-5e23-4ca6-8bc8-51a721013ccf None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:38.364291 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1514b0c-ed04-49ae-a3dc-55b150eab479 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:38.364921 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1514b0c-ed04-49ae-a3dc-55b150eab479 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:38.365442 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1514b0c-ed04-49ae-a3dc-55b150eab479 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:38.367304 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 15/27] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:50:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:38.373581 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b416bdc-b5c1-47ce-9c52-09d241729968 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:38.374276 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b416bdc-b5c1-47ce-9c52-09d241729968 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:38.374789 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b416bdc-b5c1-47ce-9c52-09d241729968 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:38.430288 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-3b416bdc-b5c1-47ce-9c52-09d241729968 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:38.431956 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-3b416bdc-b5c1-47ce-9c52-09d241729968 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:38.565179 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82450ba6-5e23-4ca6-8bc8-51a721013ccf None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:38.601579 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:38.607036 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 16/28] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:50:38.611830 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9db145-e7e9-4192-9d48-9c96f34425b0 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:38.612608 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9db145-e7e9-4192-9d48-9c96f34425b0 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:38.613383 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa9db145-e7e9-4192-9d48-9c96f34425b0 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:38.616164 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 17/29] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:50:38 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:38.627131 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20881020-2c56-4adb-8c04-19b417d29046 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:38.628044 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20881020-2c56-4adb-8c04-19b417d29046 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:38.628797 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20881020-2c56-4adb-8c04-19b417d29046 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:38.645265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:38.672249 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda69450-0aef-429b-bd29-a59ca2af15ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:38.673309 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda69450-0aef-429b-bd29-a59ca2af15ad None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:38.675314 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-20881020-2c56-4adb-8c04-19b417d29046 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:38.677351 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-20881020-2c56-4adb-8c04-19b417d29046 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:38.680989 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda69450-0aef-429b-bd29-a59ca2af15ad None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:38.681602 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bda69450-0aef-429b-bd29-a59ca2af15ad None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:38.684322 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda69450-0aef-429b-bd29-a59ca2af15ad None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:38.687076 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bda69450-0aef-429b-bd29-a59ca2af15ad None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:38.690044 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 13/30] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:50:38 2022] GET /identity/v3/domains/default => generated 199 bytes in 393 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:38.701117 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda69450-0aef-429b-bd29-a59ca2af15ad None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:39.035541 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 18/31] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:38 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:50:39.038292 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c439c-9b7a-4fc9-a62f-e7e51f4d0bc6 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:39.039101 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c439c-9b7a-4fc9-a62f-e7e51f4d0bc6 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:39.039855 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f79c439c-9b7a-4fc9-a62f-e7e51f4d0bc6 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:39.042608 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 19/32] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:50:39 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:39.059744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a04ba3-133f-4211-9c93-06ec0c8a08f7 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:39.064772 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a04ba3-133f-4211-9c93-06ec0c8a08f7 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:39.065573 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a04ba3-133f-4211-9c93-06ec0c8a08f7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:39.145254 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-79a04ba3-133f-4211-9c93-06ec0c8a08f7 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:39.149889 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-79a04ba3-133f-4211-9c93-06ec0c8a08f7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:39.176053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bda69450-0aef-429b-bd29-a59ca2af15ad None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:39.313456 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-123d7be4-a221-433e-b22b-bc3c15148d7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:39.316557 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d7be4-a221-433e-b22b-bc3c15148d7e None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:39.319200 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d7be4-a221-433e-b22b-bc3c15148d7e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:39.320736 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-123d7be4-a221-433e-b22b-bc3c15148d7e None admin] PATH_INFO: `/v3/domains/default/users/bab4a9bddb7141a48bb694677f33efcc/roles/c73e9539582145ed8eedc48648b9d738` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:39.327115 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d7be4-a221-433e-b22b-bc3c15148d7e None admin] RBAC: Authorizing `identity:create_grant(domain_id=default, user_id=bab4a9bddb7141a48bb694677f33efcc, role_id=c73e9539582145ed8eedc48648b9d738)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:39.330210 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-123d7be4-a221-433e-b22b-bc3c15148d7e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:39.429674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 20/33] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 372 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:50:39.431727 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a04ba3-133f-4211-9c93-06ec0c8a08f7 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:39.546940 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:39.566954 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 14/34] 10.222.0.49 () {58 vars in 1361 bytes} [Sun Aug 21 00:50:38 2022] PUT /identity/v3/domains/default/users/bab4a9bddb7141a48bb694677f33efcc/roles/c73e9539582145ed8eedc48648b9d738 => generated 0 bytes in 867 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 00:50:39.570842 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d23c2-4fd4-4f3f-99a5-c1bf850e3e99 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:39.571583 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d23c2-4fd4-4f3f-99a5-c1bf850e3e99 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:39.572235 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-616d23c2-4fd4-4f3f-99a5-c1bf850e3e99 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:39.586380 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 15/35] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:50:39 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:39.588468 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d23c2-4fd4-4f3f-99a5-c1bf850e3e99 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:39.627401 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79a04ba3-133f-4211-9c93-06ec0c8a08f7 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:39.697936 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8abc259-098b-4c56-8704-3f86892600f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:39.699621 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abc259-098b-4c56-8704-3f86892600f6 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:39.700572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abc259-098b-4c56-8704-3f86892600f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:39.701374 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8abc259-098b-4c56-8704-3f86892600f6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:39.723195 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8abc259-098b-4c56-8704-3f86892600f6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:39.726527 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8abc259-098b-4c56-8704-3f86892600f6 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:39.762137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-d8abc259-098b-4c56-8704-3f86892600f6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:50:39.762137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:50:39.762137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:50:39.762137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:50:39.762137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:50:39.762137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:50:39.762137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:50:39.762137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:50:39.762137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:50:39.762137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:50:39.762137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:50:39.762137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:50:39.762137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:50:39.762137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:50:39.762137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:50:39.762137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:50:39.763849 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:50:39.763849 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:50:39.763849 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:50:39.763849 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:50:39.763849 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:50:39.763849 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:50:39.763849 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:50:39.763849 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:50:39.763849 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:50:39.763849 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:50:39.763849 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:50:39.763849 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:50:39.763849 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:50:39.763849 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:50:39.763849 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:50:39.763849 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:50:39.763849 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:50:39.765511 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:50:39.765511 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:50:39.765511 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:50:39.769166 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 21/36] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:50:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 338 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:50:39.772232 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92461bd-e687-49e4-928a-7c86b186a27b None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:39.773283 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92461bd-e687-49e4-928a-7c86b186a27b None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:39.774166 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b92461bd-e687-49e4-928a-7c86b186a27b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:39.801648 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:39.822605 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-b92461bd-e687-49e4-928a-7c86b186a27b None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:39.825179 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b92461bd-e687-49e4-928a-7c86b186a27b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:39.929419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-616d23c2-4fd4-4f3f-99a5-c1bf850e3e99 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:39.961661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 22/37] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:39 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:50:39.963147 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92461bd-e687-49e4-928a-7c86b186a27b None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:40.001903 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed495471-6ff0-48f0-953a-4b791f75bca9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:40.003393 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed495471-6ff0-48f0-953a-4b791f75bca9 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:40.004995 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed495471-6ff0-48f0-953a-4b791f75bca9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:40.005844 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed495471-6ff0-48f0-953a-4b791f75bca9 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:40.007716 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed495471-6ff0-48f0-953a-4b791f75bca9 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:40.011973 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed495471-6ff0-48f0-953a-4b791f75bca9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:40.059450 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:40.065099 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 16/38] 10.222.0.49 () {60 vars in 1131 bytes} [Sun Aug 21 00:50:39 2022] POST /identity/v3/roles => generated 219 bytes in 475 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:50:40.065099 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed495471-6ff0-48f0-953a-4b791f75bca9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:40.302057 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b92461bd-e687-49e4-928a-7c86b186a27b None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:40.321718 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:40.350640 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed495471-6ff0-48f0-953a-4b791f75bca9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:40.395929 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b3de61b-8ccb-4872-8ec6-f86ef8ab447a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:40.396970 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3de61b-8ccb-4872-8ec6-f86ef8ab447a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:40.397497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3de61b-8ccb-4872-8ec6-f86ef8ab447a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:40.397918 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b3de61b-8ccb-4872-8ec6-f86ef8ab447a None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:40.399820 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3de61b-8ccb-4872-8ec6-f86ef8ab447a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:50:40.400347 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3de61b-8ccb-4872-8ec6-f86ef8ab447a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:40.403189 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b3de61b-8ccb-4872-8ec6-f86ef8ab447a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:40.448634 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 23/39] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:50:39 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 486 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:40.451077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9499ea-33ef-47ac-a35b-952c3a7a1f57 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:40.451594 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9499ea-33ef-47ac-a35b-952c3a7a1f57 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:40.451874 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f78aac54-05f1-4090-943e-610c2fbb2b7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:40.452216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff9499ea-33ef-47ac-a35b-952c3a7a1f57 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:40.452789 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78aac54-05f1-4090-943e-610c2fbb2b7a None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:40.453294 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78aac54-05f1-4090-943e-610c2fbb2b7a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:40.453763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f78aac54-05f1-4090-943e-610c2fbb2b7a None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:40.454975 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78aac54-05f1-4090-943e-610c2fbb2b7a None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:40.457723 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f78aac54-05f1-4090-943e-610c2fbb2b7a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:40.463291 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 24/40] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:50:40 2022] GET /identity => generated 270 bytes in 14 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:40.464778 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9499ea-33ef-47ac-a35b-952c3a7a1f57 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:40.494964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 17/41] 10.222.0.49 () {60 vars in 1131 bytes} [Sun Aug 21 00:50:40 2022] POST /identity/v3/roles => generated 225 bytes in 431 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:50:40.497060 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0eb88c-091a-4c0c-b864-cc46979ab0d3 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:40.497581 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0eb88c-091a-4c0c-b864-cc46979ab0d3 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:40.498194 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e0eb88c-091a-4c0c-b864-cc46979ab0d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:40.534515 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-9e0eb88c-091a-4c0c-b864-cc46979ab0d3 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:40.537901 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9e0eb88c-091a-4c0c-b864-cc46979ab0d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:40.653996 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff9499ea-33ef-47ac-a35b-952c3a7a1f57 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:40.658044 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:40.686839 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 18/42] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:50:40.688541 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0eb88c-091a-4c0c-b864-cc46979ab0d3 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:40.730087 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0ffbd-51d2-4770-9bd5-dddd1121e464 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:40.731214 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0ffbd-51d2-4770-9bd5-dddd1121e464 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:40.731951 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0ffbd-51d2-4770-9bd5-dddd1121e464 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:40.732416 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddd0ffbd-51d2-4770-9bd5-dddd1121e464 None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:40.733603 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0ffbd-51d2-4770-9bd5-dddd1121e464 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:40.738132 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddd0ffbd-51d2-4770-9bd5-dddd1121e464 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:40.919651 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:40.955151 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e0eb88c-091a-4c0c-b864-cc46979ab0d3 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:41.029575 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee4563-f434-491b-b614-30e6e2789bdc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:41.030248 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee4563-f434-491b-b614-30e6e2789bdc None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:41.030530 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee4563-f434-491b-b614-30e6e2789bdc None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:41.030807 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cee4563-f434-491b-b614-30e6e2789bdc None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:41.032139 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee4563-f434-491b-b614-30e6e2789bdc None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:41.033861 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cee4563-f434-491b-b614-30e6e2789bdc None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:41.035571 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 19/43] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:50:40 2022] GET /identity/v3/domains/default => generated 199 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:41.041900 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee4563-f434-491b-b614-30e6e2789bdc None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:41.138257 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 25/44] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 21 00:50:40 2022] POST /identity/v3/projects => generated 301 bytes in 674 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:50:41.166093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cee4563-f434-491b-b614-30e6e2789bdc None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:41.207915 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b935deb-7c2e-4eb3-a7e1-73c26fa5fce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:41.208556 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b935deb-7c2e-4eb3-a7e1-73c26fa5fce8 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:41.208840 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b935deb-7c2e-4eb3-a7e1-73c26fa5fce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:41.209176 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b935deb-7c2e-4eb3-a7e1-73c26fa5fce8 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:41.209868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b935deb-7c2e-4eb3-a7e1-73c26fa5fce8 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:41.211364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b935deb-7c2e-4eb3-a7e1-73c26fa5fce8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:41.262825 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0ffbd-51d2-4770-9bd5-dddd1121e464 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:41.263290 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 20/45] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 21 00:50:41 2022] POST /identity/v3/projects => generated 312 bytes in 222 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:50:41.478965 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddd0ffbd-51d2-4770-9bd5-dddd1121e464 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:41.542152 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0f378d6-c3eb-483e-bf0d-aad1e5c8b385 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:41.543270 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f378d6-c3eb-483e-bf0d-aad1e5c8b385 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:41.543771 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f378d6-c3eb-483e-bf0d-aad1e5c8b385 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:41.544257 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0f378d6-c3eb-483e-bf0d-aad1e5c8b385 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:41.545597 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f378d6-c3eb-483e-bf0d-aad1e5c8b385 None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:41.548520 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0f378d6-c3eb-483e-bf0d-aad1e5c8b385 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:41.585082 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 26/46] 10.222.0.49 () {60 vars in 1131 bytes} [Sun Aug 21 00:50:41 2022] POST /identity/v3/roles => generated 223 bytes in 317 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:50:42.188475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3068c4-bec9-4801-a6de-6e1d5d1702a7 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:42.189021 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3068c4-bec9-4801-a6de-6e1d5d1702a7 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:42.189322 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f3068c4-bec9-4801-a6de-6e1d5d1702a7 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:42.190866 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 21/47] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:50:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:42.197480 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3200589-38f1-4ae1-b0ce-2deef0ef3f4c None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:42.198298 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3200589-38f1-4ae1-b0ce-2deef0ef3f4c None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:42.198442 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3200589-38f1-4ae1-b0ce-2deef0ef3f4c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:42.224587 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-e3200589-38f1-4ae1-b0ce-2deef0ef3f4c None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:42.227034 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-e3200589-38f1-4ae1-b0ce-2deef0ef3f4c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:42.244068 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:42.325818 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 27/48] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:50:42.592837 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3068c4-bec9-4801-a6de-6e1d5d1702a7 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:42.606943 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:42.756542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f3068c4-bec9-4801-a6de-6e1d5d1702a7 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:42.798792 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711ed72-6258-438f-bb20-e137361dcbf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:42.799462 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711ed72-6258-438f-bb20-e137361dcbf5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:42.799744 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711ed72-6258-438f-bb20-e137361dcbf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:42.800021 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8711ed72-6258-438f-bb20-e137361dcbf5 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:42.815226 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8711ed72-6258-438f-bb20-e137361dcbf5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:50:42.821381 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-8711ed72-6258-438f-bb20-e137361dcbf5 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:50:42.821381 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:50:42.821381 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:50:42.821381 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:50:42.821381 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:50:42.821381 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:50:42.821381 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:50:42.821381 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:50:42.821381 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:50:42.821381 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:50:42.821381 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:50:42.821381 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:50:42.821381 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:50:42.821381 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:50:42.821381 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:50:42.821381 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:50:42.822472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:50:42.822472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:50:42.822472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:50:42.822472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:50:42.822472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:50:42.822472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:50:42.822472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:50:42.822472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:50:42.822472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:50:42.822472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:50:42.822472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:50:42.822472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:50:42.822472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:50:42.822472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:50:42.822472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:50:42.822472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:50:42.823796 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:50:42.823796 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:50:42.823796 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:50:42.823796 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:50:42.823796 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:50:42.823796 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:50:42.823796 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:50:42.823796 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:50:42.823796 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:50:42.823796 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:50:42.823796 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:50:42.823796 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:50:42.823796 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 22/49] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:50:42 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:50:42.829209 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3200589-38f1-4ae1-b0ce-2deef0ef3f4c None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:42.968275 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3200589-38f1-4ae1-b0ce-2deef0ef3f4c None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:43.033031 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3dd95-b25f-41d6-9b39-b5531a31e1b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:43.034100 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3dd95-b25f-41d6-9b39-b5531a31e1b7 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:43.034568 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3dd95-b25f-41d6-9b39-b5531a31e1b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:43.035004 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43c3dd95-b25f-41d6-9b39-b5531a31e1b7 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:43.036238 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c3dd95-b25f-41d6-9b39-b5531a31e1b7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:50:43.036744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c3dd95-b25f-41d6-9b39-b5531a31e1b7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:43.039323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43c3dd95-b25f-41d6-9b39-b5531a31e1b7 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:43.055864 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 28/50] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:50:42 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:43.064581 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711ed72-6258-438f-bb20-e137361dcbf5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:43.176184 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:43.226928 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8711ed72-6258-438f-bb20-e137361dcbf5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:43.276412 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e182c1-ad4d-4ce7-a6e2-42d4c31d35d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:43.277282 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e182c1-ad4d-4ce7-a6e2-42d4c31d35d3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:43.277666 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e182c1-ad4d-4ce7-a6e2-42d4c31d35d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:43.278029 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e182c1-ad4d-4ce7-a6e2-42d4c31d35d3 None admin] PATH_INFO: `/v3/users/bab4a9bddb7141a48bb694677f33efcc` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:43.279362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e182c1-ad4d-4ce7-a6e2-42d4c31d35d3 None admin] RBAC: Authorizing `identity:get_user(user_id=bab4a9bddb7141a48bb694677f33efcc)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:43.280989 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17e182c1-ad4d-4ce7-a6e2-42d4c31d35d3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:43.282865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 23/51] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:50:43 2022] GET /identity/v3/users/bab4a9bddb7141a48bb694677f33efcc => generated 247 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:43.292300 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3dd95-b25f-41d6-9b39-b5531a31e1b7 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:43.307219 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:43.424088 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43c3dd95-b25f-41d6-9b39-b5531a31e1b7 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:43.465324 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ba6a361-4d41-43cf-b3a9-480c67213900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:43.465991 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6a361-4d41-43cf-b3a9-480c67213900 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:43.466274 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6a361-4d41-43cf-b3a9-480c67213900 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:43.466552 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ba6a361-4d41-43cf-b3a9-480c67213900 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:43.467783 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6a361-4d41-43cf-b3a9-480c67213900 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:43.469335 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ba6a361-4d41-43cf-b3a9-480c67213900 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:43.471121 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 29/52] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:50:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:50:43.477067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e182c1-ad4d-4ce7-a6e2-42d4c31d35d3 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:43.562144 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5854521-2d8f-4ecb-aec8-6627bc489e5c None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:43.562422 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5854521-2d8f-4ecb-aec8-6627bc489e5c None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:43.562701 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5854521-2d8f-4ecb-aec8-6627bc489e5c None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:43.564148 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 30/53] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:50:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:43.572403 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c740e-058d-4304-b805-c85ad06fa7f6 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:43.572711 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c740e-058d-4304-b805-c85ad06fa7f6 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:43.573473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc2c740e-058d-4304-b805-c85ad06fa7f6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:43.595228 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-fc2c740e-058d-4304-b805-c85ad06fa7f6 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:43.596573 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-fc2c740e-058d-4304-b805-c85ad06fa7f6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:43.602494 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17e182c1-ad4d-4ce7-a6e2-42d4c31d35d3 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:43.644455 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c75b2c-76ee-4582-8eed-04dc6615dde7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:43.645216 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c75b2c-76ee-4582-8eed-04dc6615dde7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:43.645414 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c75b2c-76ee-4582-8eed-04dc6615dde7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:43.645686 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0c75b2c-76ee-4582-8eed-04dc6615dde7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:43.646447 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c75b2c-76ee-4582-8eed-04dc6615dde7 None admin] RBAC: Adding query filter params (role.id=c73e9539582145ed8eedc48648b9d738, scope.domain.id=default, user.id=bab4a9bddb7141a48bb694677f33efcc) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:50:43.646756 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c75b2c-76ee-4582-8eed-04dc6615dde7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:43.648307 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0c75b2c-76ee-4582-8eed-04dc6615dde7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:43.651744 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:43.660307 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 24/54] 10.222.0.49 () {56 vars in 1322 bytes} [Sun Aug 21 00:50:43 2022] GET /identity/v3/role_assignments?user.id=bab4a9bddb7141a48bb694677f33efcc&scope.domain.id=default&role.id=c73e9539582145ed8eedc48648b9d738 => generated 530 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:43.702113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 31/55] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:50:44.115142 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c75b2c-76ee-4582-8eed-04dc6615dde7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:44.218928 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0c75b2c-76ee-4582-8eed-04dc6615dde7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:44.255947 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1942b5db-9a58-4dfe-956a-511f8e35ad7e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:44.256612 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942b5db-9a58-4dfe-956a-511f8e35ad7e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:44.256861 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942b5db-9a58-4dfe-956a-511f8e35ad7e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:44.257168 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1942b5db-9a58-4dfe-956a-511f8e35ad7e None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:44.258327 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942b5db-9a58-4dfe-956a-511f8e35ad7e None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:44.259803 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1942b5db-9a58-4dfe-956a-511f8e35ad7e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:44.261463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 25/56] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:50:44 2022] GET /identity/v3/domains/default => generated 199 bytes in 147 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:44.267511 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c740e-058d-4304-b805-c85ad06fa7f6 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:44.276035 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:44.372624 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc2c740e-058d-4304-b805-c85ad06fa7f6 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:44.407750 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8566a9ae-1b3a-4363-9d52-5eceb1d07e7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:44.408372 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566a9ae-1b3a-4363-9d52-5eceb1d07e7d None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:44.408636 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566a9ae-1b3a-4363-9d52-5eceb1d07e7d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:44.408918 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8566a9ae-1b3a-4363-9d52-5eceb1d07e7d None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:44.409615 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566a9ae-1b3a-4363-9d52-5eceb1d07e7d None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:44.411070 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8566a9ae-1b3a-4363-9d52-5eceb1d07e7d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:44.439078 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 32/57] 10.222.0.49 () {60 vars in 1140 bytes} [Sun Aug 21 00:50:44 2022] POST /identity/v3/projects => generated 298 bytes in 172 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:50:46.335371 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb5bbf-fb7e-4a2a-bea6-000e0b1d37bb None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:46.335916 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb5bbf-fb7e-4a2a-bea6-000e0b1d37bb None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:46.336034 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fdb5bbf-fb7e-4a2a-bea6-000e0b1d37bb None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:46.338103 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 26/58] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:50:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:46.346137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b9469-09b0-40dd-a9db-5f323c33d351 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:46.346665 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b9469-09b0-40dd-a9db-5f323c33d351 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:46.346665 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1b9469-09b0-40dd-a9db-5f323c33d351 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:46.365665 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-eb1b9469-09b0-40dd-a9db-5f323c33d351 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:46.366888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-eb1b9469-09b0-40dd-a9db-5f323c33d351 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:46.422564 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:46.436942 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 33/59] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:50:46.704699 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb5bbf-fb7e-4a2a-bea6-000e0b1d37bb None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:46.789127 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:46.831628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fdb5bbf-fb7e-4a2a-bea6-000e0b1d37bb None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:46.976321 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5d7188-801e-42ab-a3b7-23d790126bf9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:46.976865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d7188-801e-42ab-a3b7-23d790126bf9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:46.977167 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d7188-801e-42ab-a3b7-23d790126bf9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:46.977445 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5d7188-801e-42ab-a3b7-23d790126bf9 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:46.978629 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d7188-801e-42ab-a3b7-23d790126bf9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:46.980083 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5d7188-801e-42ab-a3b7-23d790126bf9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:46.981764 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 27/60] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:50:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:46.987767 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b9469-09b0-40dd-a9db-5f323c33d351 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:47.089226 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1b9469-09b0-40dd-a9db-5f323c33d351 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:47.124504 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f91c0f2-4b6c-4255-b2d3-d18d89e6f937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:47.125348 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91c0f2-4b6c-4255-b2d3-d18d89e6f937 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:47.125473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91c0f2-4b6c-4255-b2d3-d18d89e6f937 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:47.125686 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f91c0f2-4b6c-4255-b2d3-d18d89e6f937 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:47.126647 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91c0f2-4b6c-4255-b2d3-d18d89e6f937 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:47.128100 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f91c0f2-4b6c-4255-b2d3-d18d89e6f937 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:47.156371 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 34/61] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 21 00:50:46 2022] POST /identity/v3/users => generated 275 bytes in 169 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:50:50.190345 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f8603-b776-46ed-b552-1ac414fd8e57 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:50.191454 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f8603-b776-46ed-b552-1ac414fd8e57 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:50.191954 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-793f8603-b776-46ed-b552-1ac414fd8e57 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:50.193666 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 28/62] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:50:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:50.199591 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64a60d-b565-4173-b17f-d1692f3850d8 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:50.200564 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64a60d-b565-4173-b17f-d1692f3850d8 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:50.201311 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a64a60d-b565-4173-b17f-d1692f3850d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:50.230441 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-0a64a60d-b565-4173-b17f-d1692f3850d8 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:50.231782 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-0a64a60d-b565-4173-b17f-d1692f3850d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:50.299127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:50.341892 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 35/63] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 143 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:50:50.614206 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f88153-e8d9-4c3a-9e7a-d1ee49544fa3 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:50.614934 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f88153-e8d9-4c3a-9e7a-d1ee49544fa3 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:50.615455 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f88153-e8d9-4c3a-9e7a-d1ee49544fa3 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:50.617063 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 29/64] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:50:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:50.624069 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499471d-1689-4d00-a82d-3a26b6ceb790 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:50.624451 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499471d-1689-4d00-a82d-3a26b6ceb790 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:50.624696 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6499471d-1689-4d00-a82d-3a26b6ceb790 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:50.651311 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-6499471d-1689-4d00-a82d-3a26b6ceb790 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:50.652598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-6499471d-1689-4d00-a82d-3a26b6ceb790 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:50.696671 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841424e-dc30-41ac-9b1f-478a23461d9a None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:50.697438 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841424e-dc30-41ac-9b1f-478a23461d9a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:50.698169 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a841424e-dc30-41ac-9b1f-478a23461d9a None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:50.699948 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 30/65] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:50:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:50:50.705845 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29118daf-0421-429e-a408-e96533150080 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:50.706430 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29118daf-0421-429e-a408-e96533150080 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:50.706904 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29118daf-0421-429e-a408-e96533150080 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:50.728099 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-29118daf-0421-429e-a408-e96533150080 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:50.730878 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-29118daf-0421-429e-a408-e96533150080 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:50.756039 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 36/66] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 133 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:50:50.757362 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499471d-1689-4d00-a82d-3a26b6ceb790 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:50.879560 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 31/67] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:50:50.963345 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe8cd3-2a14-4493-9dab-f3eb0ef09a63 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:50.964011 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe8cd3-2a14-4493-9dab-f3eb0ef09a63 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:50.964476 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22fe8cd3-2a14-4493-9dab-f3eb0ef09a63 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:50.966165 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 32/68] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:50:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:50:50.971846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ad227-29d4-4118-911d-9deae1ab5f9a None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:50.972452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ad227-29d4-4118-911d-9deae1ab5f9a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:50.972953 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-224ad227-29d4-4118-911d-9deae1ab5f9a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:50.991371 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6499471d-1689-4d00-a82d-3a26b6ceb790 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:50.995916 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:51.010455 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-224ad227-29d4-4118-911d-9deae1ab5f9a None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:51.012885 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-224ad227-29d4-4118-911d-9deae1ab5f9a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:51.062104 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-907ff638-c4e5-4339-8986-26db4c492332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:51.063545 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ff638-c4e5-4339-8986-26db4c492332 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:51.064281 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ff638-c4e5-4339-8986-26db4c492332 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:51.065085 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-907ff638-c4e5-4339-8986-26db4c492332 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:51.083168 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-907ff638-c4e5-4339-8986-26db4c492332 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:50:51.092385 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-907ff638-c4e5-4339-8986-26db4c492332 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:50:51.092385 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:50:51.092385 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:50:51.092385 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:50:51.092385 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:50:51.092385 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:50:51.092385 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:50:51.092385 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:50:51.092385 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:50:51.092385 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:50:51.092385 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:50:51.092385 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:50:51.092385 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:50:51.092385 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:50:51.092385 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:50:51.092385 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:50:51.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:50:51.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:50:51.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:50:51.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:50:51.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:50:51.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:50:51.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:50:51.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:50:51.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:50:51.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:50:51.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:50:51.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:50:51.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:50:51.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:50:51.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:50:51.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:50:51.095337 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:50:51.095337 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:50:51.095337 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:50:51.095337 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:50:51.095337 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:50:51.095337 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:50:51.095337 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:50:51.095337 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:50:51.095337 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:50:51.095337 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:50:51.095337 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:50:51.095337 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:50:51.099841 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 37/69] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:50:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:50:51.100840 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:51.105415 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ecff7-73da-4a38-b1e2-250288cd5c20 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:51.106487 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ecff7-73da-4a38-b1e2-250288cd5c20 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:51.108245 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-663ecff7-73da-4a38-b1e2-250288cd5c20 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:51.111725 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 38/70] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:50:51 2022] GET /identity => generated 270 bytes in 11 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:51.113541 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ecff7-73da-4a38-b1e2-250288cd5c20 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:51.121360 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 33/71] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 150 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:50:51.123007 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1a9a4-915a-4295-be0c-a8fae358b608 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:51.123441 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1a9a4-915a-4295-be0c-a8fae358b608 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:51.123856 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0c1a9a4-915a-4295-be0c-a8fae358b608 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:51.147279 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-a0c1a9a4-915a-4295-be0c-a8fae358b608 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:51.148901 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a0c1a9a4-915a-4295-be0c-a8fae358b608 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:51.269372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 34/72] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:50:51.270326 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1a9a4-915a-4295-be0c-a8fae358b608 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:51.342012 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-663ecff7-73da-4a38-b1e2-250288cd5c20 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:51.414253 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a01f93-092c-4a12-8cc6-ce38050d470e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:51.416376 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a01f93-092c-4a12-8cc6-ce38050d470e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:51.417201 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a01f93-092c-4a12-8cc6-ce38050d470e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:51.418621 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67a01f93-092c-4a12-8cc6-ce38050d470e None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:51.420522 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a01f93-092c-4a12-8cc6-ce38050d470e None admin] RBAC: Adding query filter params (name=member) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:50:51.421310 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a01f93-092c-4a12-8cc6-ce38050d470e None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:51.425185 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67a01f93-092c-4a12-8cc6-ce38050d470e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:51.448157 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 39/73] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:50:51 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:51.449985 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a01f93-092c-4a12-8cc6-ce38050d470e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:51.468538 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0c1a9a4-915a-4295-be0c-a8fae358b608 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:51.512914 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:51.513709 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:51.537503 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8763cac-5dc9-466f-b81d-46d751d88419 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:51.538893 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8763cac-5dc9-466f-b81d-46d751d88419 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:51.539549 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8763cac-5dc9-466f-b81d-46d751d88419 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:51.540238 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8763cac-5dc9-466f-b81d-46d751d88419 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:51.565988 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8763cac-5dc9-466f-b81d-46d751d88419 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:50:51.576347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-e8763cac-5dc9-466f-b81d-46d751d88419 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:50:51.576347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:50:51.576347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:50:51.576347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:50:51.576347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:50:51.576347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:50:51.576347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:50:51.576347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:50:51.576347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:50:51.576347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:50:51.576347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:50:51.576347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:50:51.576347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:50:51.576347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:50:51.576347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:50:51.576347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:50:51.578296 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:50:51.578296 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:50:51.578296 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:50:51.578296 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:50:51.578296 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:50:51.578296 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:50:51.578296 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:50:51.578296 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:50:51.578296 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:50:51.578296 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:50:51.578296 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:50:51.578296 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:50:51.578296 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:50:51.578296 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:50:51.578296 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:50:51.578296 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:50:51.579788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:50:51.579788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:50:51.579788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:50:51.579788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:50:51.579788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:50:51.579788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:50:51.579788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:50:51.579788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:50:51.579788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:50:51.579788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:50:51.579788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:50:51.579788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:50:51.579788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 35/74] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:50:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:50:51.581797 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8763cac-5dc9-466f-b81d-46d751d88419 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:51.673131 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67a01f93-092c-4a12-8cc6-ce38050d470e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:51.735531 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf192921-049e-4b20-a06e-a6d0e4bcbeed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:51.736611 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf192921-049e-4b20-a06e-a6d0e4bcbeed None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:51.737132 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf192921-049e-4b20-a06e-a6d0e4bcbeed None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:51.737617 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf192921-049e-4b20-a06e-a6d0e4bcbeed None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:51.758618 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf192921-049e-4b20-a06e-a6d0e4bcbeed None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:50:51.768908 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-bf192921-049e-4b20-a06e-a6d0e4bcbeed None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:50:51.768908 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:50:51.768908 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:50:51.768908 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:50:51.768908 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:50:51.768908 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:50:51.768908 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:50:51.768908 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:50:51.768908 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:50:51.768908 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:50:51.768908 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:50:51.768908 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:50:51.768908 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:50:51.768908 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:50:51.768908 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:50:51.768908 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:50:51.770681 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:50:51.770681 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:50:51.770681 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:50:51.770681 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:50:51.770681 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:50:51.770681 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:50:51.770681 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:50:51.770681 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:50:51.770681 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:50:51.770681 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:50:51.770681 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:50:51.770681 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:50:51.770681 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:50:51.770681 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:50:51.770681 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:50:51.770681 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:50:51.772073 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:50:51.772073 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:50:51.772073 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:50:51.772073 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:50:51.772073 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:50:51.772073 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:50:51.772073 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:50:51.772073 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:50:51.772073 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:50:51.772073 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:50:51.772073 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:50:51.772073 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:50:51.772757 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8763cac-5dc9-466f-b81d-46d751d88419 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:51.772862 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 40/75] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 21 00:50:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 322 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:50:51.772862 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf192921-049e-4b20-a06e-a6d0e4bcbeed None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:51.812141 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab283f-c640-42e5-a2e4-c2819683f7b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:51.813081 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab283f-c640-42e5-a2e4-c2819683f7b8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:51.813542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab283f-c640-42e5-a2e4-c2819683f7b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:51.813979 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4fab283f-c640-42e5-a2e4-c2819683f7b8 None admin] PATH_INFO: `/v3/users/5964ab09eab9453db0a9316d1da8e974` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:51.840691 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab283f-c640-42e5-a2e4-c2819683f7b8 None admin] RBAC: Authorizing `identity:get_user(user_id=5964ab09eab9453db0a9316d1da8e974)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:51.843221 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4fab283f-c640-42e5-a2e4-c2819683f7b8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:51.846113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 36/76] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:50:51 2022] GET /identity/v3/users/5964ab09eab9453db0a9316d1da8e974 => generated 275 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:51.847429 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab283f-c640-42e5-a2e4-c2819683f7b8 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:51.913720 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:51.922809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:51.950002 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf192921-049e-4b20-a06e-a6d0e4bcbeed None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:51.983640 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4fab283f-c640-42e5-a2e4-c2819683f7b8 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:52.008222 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8555a5-8612-4cb3-b3f4-ad7871d245b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:52.009281 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8555a5-8612-4cb3-b3f4-ad7871d245b9 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:52.009786 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8555a5-8612-4cb3-b3f4-ad7871d245b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:52.010299 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c8555a5-8612-4cb3-b3f4-ad7871d245b9 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:52.011565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8555a5-8612-4cb3-b3f4-ad7871d245b9 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:50:52.012104 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8555a5-8612-4cb3-b3f4-ad7871d245b9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:52.014749 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c8555a5-8612-4cb3-b3f4-ad7871d245b9 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:52.030593 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 41/77] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:50:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:52.032449 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8555a5-8612-4cb3-b3f4-ad7871d245b9 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:52.040557 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a15f5-6901-4415-9f0f-0335dec5a14e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:52.041685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a15f5-6901-4415-9f0f-0335dec5a14e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:52.042162 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a15f5-6901-4415-9f0f-0335dec5a14e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:52.042703 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d60a15f5-6901-4415-9f0f-0335dec5a14e None admin] PATH_INFO: `/v3/roles/member` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:52.062661 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d60a15f5-6901-4415-9f0f-0335dec5a14e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:50:52.072021 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-d60a15f5-6901-4415-9f0f-0335dec5a14e None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:50:52.072021 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:50:52.072021 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:50:52.072021 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:50:52.072021 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:50:52.072021 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:50:52.072021 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:50:52.072021 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:50:52.072021 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:50:52.072021 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:50:52.072021 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:50:52.072021 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:50:52.072021 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:50:52.072021 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:50:52.072021 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:50:52.072021 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:50:52.073640 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:50:52.073640 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:50:52.073640 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:50:52.073640 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:50:52.073640 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:50:52.073640 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:50:52.073640 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:50:52.073640 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:50:52.073640 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:50:52.073640 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:50:52.073640 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:50:52.073640 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:50:52.073640 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:50:52.073640 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:50:52.073640 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:50:52.073640 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:50:52.074762 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:50:52.074762 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:50:52.074762 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:50:52.074762 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:50:52.074762 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:50:52.074762 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:50:52.074762 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:50:52.074762 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:50:52.074762 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:50:52.074762 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:50:52.074762 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:50:52.074762 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:50:52.074762 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 37/78] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:50:51 2022] GET /identity/v3/roles/member => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:50:52.075514 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a15f5-6901-4415-9f0f-0335dec5a14e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:52.161830 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c8555a5-8612-4cb3-b3f4-ad7871d245b9 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:52.217662 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d60a15f5-6901-4415-9f0f-0335dec5a14e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:52.219794 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:52.221712 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545d669-574c-47c8-8db3-29e3622aeac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:52.222739 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545d669-574c-47c8-8db3-29e3622aeac8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:52.223219 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545d669-574c-47c8-8db3-29e3622aeac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:52.223692 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d545d669-574c-47c8-8db3-29e3622aeac8 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:52.225684 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545d669-574c-47c8-8db3-29e3622aeac8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:52.229841 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d545d669-574c-47c8-8db3-29e3622aeac8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:52.231666 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 42/79] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:50:52 2022] GET /identity/v3/domains/default => generated 199 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:52.233114 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545d669-574c-47c8-8db3-29e3622aeac8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:52.263018 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:52.273465 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171857d9-7231-426a-b6be-7cb2aa31f995 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:52.274379 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171857d9-7231-426a-b6be-7cb2aa31f995 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:52.274824 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171857d9-7231-426a-b6be-7cb2aa31f995 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:52.275262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171857d9-7231-426a-b6be-7cb2aa31f995 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:52.276362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171857d9-7231-426a-b6be-7cb2aa31f995 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:50:52.276853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171857d9-7231-426a-b6be-7cb2aa31f995 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:52.279184 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171857d9-7231-426a-b6be-7cb2aa31f995 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:52.293505 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 38/80] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:50:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:52.294900 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171857d9-7231-426a-b6be-7cb2aa31f995 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:52.383097 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d545d669-574c-47c8-8db3-29e3622aeac8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:52.434208 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f62757-8889-4a81-a85c-7e2ffebf54e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:52.434912 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f62757-8889-4a81-a85c-7e2ffebf54e1 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:52.435253 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f62757-8889-4a81-a85c-7e2ffebf54e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:52.435548 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171857d9-7231-426a-b6be-7cb2aa31f995 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:52.435737 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4f62757-8889-4a81-a85c-7e2ffebf54e1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:52.486843 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821783c-e52d-46fb-8f66-85074df9b955 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:52.487718 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821783c-e52d-46fb-8f66-85074df9b955 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:52.488157 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821783c-e52d-46fb-8f66-85074df9b955 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:52.488579 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e821783c-e52d-46fb-8f66-85074df9b955 None admin] PATH_INFO: `/v3/users/bab4a9bddb7141a48bb694677f33efcc` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:52.490418 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821783c-e52d-46fb-8f66-85074df9b955 None admin] RBAC: Authorizing `identity:get_user(user_id=bab4a9bddb7141a48bb694677f33efcc)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:52.492746 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e821783c-e52d-46fb-8f66-85074df9b955 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:52.495373 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 39/81] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:50:52 2022] GET /identity/v3/users/bab4a9bddb7141a48bb694677f33efcc => generated 247 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:52.496710 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821783c-e52d-46fb-8f66-85074df9b955 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:52.536958 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f62757-8889-4a81-a85c-7e2ffebf54e1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:52.539120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4f62757-8889-4a81-a85c-7e2ffebf54e1 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:52.546768 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:52.561910 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:52.631245 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e821783c-e52d-46fb-8f66-85074df9b955 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:52.667596 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec776807-0c2d-4314-8f10-1294f953dab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:52.668214 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec776807-0c2d-4314-8f10-1294f953dab5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:52.668498 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec776807-0c2d-4314-8f10-1294f953dab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:52.668760 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec776807-0c2d-4314-8f10-1294f953dab5 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:52.669487 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec776807-0c2d-4314-8f10-1294f953dab5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:50:52.669796 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec776807-0c2d-4314-8f10-1294f953dab5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:52.671196 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec776807-0c2d-4314-8f10-1294f953dab5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:52.680580 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 40/82] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:50:52 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:52.681272 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec776807-0c2d-4314-8f10-1294f953dab5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:52.688595 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 43/83] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:50:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 457 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:50:52.689764 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f62757-8889-4a81-a85c-7e2ffebf54e1 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:52.800334 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:52.809227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec776807-0c2d-4314-8f10-1294f953dab5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:52.830078 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4f62757-8889-4a81-a85c-7e2ffebf54e1 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:52.849575 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:52.854524 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d78fb-e653-48c5-ad04-2948413b62f1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:52.855476 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d78fb-e653-48c5-ad04-2948413b62f1 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:52.855919 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d78fb-e653-48c5-ad04-2948413b62f1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:52.856893 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-171d78fb-e653-48c5-ad04-2948413b62f1 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:52.858004 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d78fb-e653-48c5-ad04-2948413b62f1 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:52.860665 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-171d78fb-e653-48c5-ad04-2948413b62f1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:52.877584 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3922923-32fa-45a1-942c-2333cee0317c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:52.878571 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3922923-32fa-45a1-942c-2333cee0317c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:52.879016 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3922923-32fa-45a1-942c-2333cee0317c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:52.879439 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3922923-32fa-45a1-942c-2333cee0317c None admin] PATH_INFO: `/v3/users/5964ab09eab9453db0a9316d1da8e974` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:52.881258 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3922923-32fa-45a1-942c-2333cee0317c None admin] RBAC: Authorizing `identity:get_user(user_id=5964ab09eab9453db0a9316d1da8e974)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:52.883612 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3922923-32fa-45a1-942c-2333cee0317c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:52.886860 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 44/84] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:50:52 2022] GET /identity/v3/users/5964ab09eab9453db0a9316d1da8e974 => generated 275 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:52.888296 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3922923-32fa-45a1-942c-2333cee0317c None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:52.902200 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 41/85] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 21 00:50:52 2022] POST /identity/v3/users => generated 289 bytes in 221 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:50:52.903471 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d78fb-e653-48c5-ad04-2948413b62f1 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:53.043078 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3922923-32fa-45a1-942c-2333cee0317c None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:53.066092 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-171d78fb-e653-48c5-ad04-2948413b62f1 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:53.102033 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c45c0-8b0d-4bee-844a-50edc012550e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:53.103007 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c45c0-8b0d-4bee-844a-50edc012550e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:53.103474 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c45c0-8b0d-4bee-844a-50edc012550e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:53.103940 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-855c45c0-8b0d-4bee-844a-50edc012550e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:53.126351 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b083a20-1db0-41d2-b3c8-1b20a3820044 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:53.127189 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b083a20-1db0-41d2-b3c8-1b20a3820044 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:53.127552 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b083a20-1db0-41d2-b3c8-1b20a3820044 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:53.127993 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b083a20-1db0-41d2-b3c8-1b20a3820044 None admin] PATH_INFO: `/v3/users/5964ab09eab9453db0a9316d1da8e974` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:53.129696 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b083a20-1db0-41d2-b3c8-1b20a3820044 None admin] RBAC: Authorizing `identity:get_user(user_id=5964ab09eab9453db0a9316d1da8e974)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:53.132149 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b083a20-1db0-41d2-b3c8-1b20a3820044 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:53.134865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 42/86] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:50:52 2022] GET /identity/v3/users/5964ab09eab9453db0a9316d1da8e974 => generated 275 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:53.136001 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b083a20-1db0-41d2-b3c8-1b20a3820044 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:53.172640 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:53.200622 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:53.239609 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c45c0-8b0d-4bee-844a-50edc012550e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:53.241915 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-855c45c0-8b0d-4bee-844a-50edc012550e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:53.329086 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b083a20-1db0-41d2-b3c8-1b20a3820044 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:53.392025 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8794c1-aa05-4704-b2e6-23ab1de23a3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:53.393182 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8794c1-aa05-4704-b2e6-23ab1de23a3d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:53.393607 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8794c1-aa05-4704-b2e6-23ab1de23a3d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:53.394067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a8794c1-aa05-4704-b2e6-23ab1de23a3d None admin] PATH_INFO: `/v3/projects/f868b361cbe341f981c4c6441e332398` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:53.395892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8794c1-aa05-4704-b2e6-23ab1de23a3d None admin] RBAC: Authorizing `identity:get_project(project_id=f868b361cbe341f981c4c6441e332398)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:53.398585 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a8794c1-aa05-4704-b2e6-23ab1de23a3d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:53.401507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 43/87] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:50:53 2022] GET /identity/v3/projects/f868b361cbe341f981c4c6441e332398 => generated 298 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:53.403011 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8794c1-aa05-4704-b2e6-23ab1de23a3d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:53.435918 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 45/88] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:50:52 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 548 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:50:53.439802 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c45c0-8b0d-4bee-844a-50edc012550e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:53.560364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:53.589621 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:53.591091 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a8794c1-aa05-4704-b2e6-23ab1de23a3d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:53.618695 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-855c45c0-8b0d-4bee-844a-50edc012550e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:53.652152 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5a2e9-6f2c-426d-ac0d-f591552cef9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:53.653624 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5a2e9-6f2c-426d-ac0d-f591552cef9b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:53.654357 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5a2e9-6f2c-426d-ac0d-f591552cef9b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:53.655077 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4f5a2e9-6f2c-426d-ac0d-f591552cef9b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:53.680012 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491a09c-06a6-4a86-8875-975930364126 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:53.681035 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491a09c-06a6-4a86-8875-975930364126 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:53.681548 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491a09c-06a6-4a86-8875-975930364126 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:53.682003 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d491a09c-06a6-4a86-8875-975930364126 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:53.788194 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5a2e9-6f2c-426d-ac0d-f591552cef9b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:53.791507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4f5a2e9-6f2c-426d-ac0d-f591552cef9b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:53.804810 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491a09c-06a6-4a86-8875-975930364126 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:53.807807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d491a09c-06a6-4a86-8875-975930364126 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:53.960378 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:53.973649 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:53.990114 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 46/89] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:50:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:50:53.993691 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 44/90] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:50:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 591 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:50:53.998044 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491a09c-06a6-4a86-8875-975930364126 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:53.999975 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5a2e9-6f2c-426d-ac0d-f591552cef9b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:54.188286 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d491a09c-06a6-4a86-8875-975930364126 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:54.191388 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4f5a2e9-6f2c-426d-ac0d-f591552cef9b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:54.256392 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee47588-ad17-477f-bbf1-d9d17af4a5ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:54.257237 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee47588-ad17-477f-bbf1-d9d17af4a5ae None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:54.257614 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee47588-ad17-477f-bbf1-d9d17af4a5ae None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:54.257980 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fee47588-ad17-477f-bbf1-d9d17af4a5ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:54.258822 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee47588-ad17-477f-bbf1-d9d17af4a5ae None admin] RBAC: Adding query filter params (role.id=54545d831b9e469dad64f2d28c12e462, scope.project.id=f868b361cbe341f981c4c6441e332398, user.id=5964ab09eab9453db0a9316d1da8e974) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:50:54.259228 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee47588-ad17-477f-bbf1-d9d17af4a5ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:54.261157 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fee47588-ad17-477f-bbf1-d9d17af4a5ae None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:54.273086 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 47/91] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:50:53 2022] GET /identity/v3/role_assignments?user.id=5964ab09eab9453db0a9316d1da8e974&scope.project.id=f868b361cbe341f981c4c6441e332398&role.id=54545d831b9e469dad64f2d28c12e462 => generated 259 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:54.273086 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee47588-ad17-477f-bbf1-d9d17af4a5ae None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:54.294434 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b322c-0bca-4f56-a04c-7476661e2e54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:54.295817 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b322c-0bca-4f56-a04c-7476661e2e54 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:54.296506 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b322c-0bca-4f56-a04c-7476661e2e54 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:54.297246 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326b322c-0bca-4f56-a04c-7476661e2e54 None admin] PATH_INFO: `/v3/projects/f868b361cbe341f981c4c6441e332398` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:54.302117 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b322c-0bca-4f56-a04c-7476661e2e54 None admin] RBAC: Authorizing `identity:get_project(project_id=f868b361cbe341f981c4c6441e332398)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:54.308627 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326b322c-0bca-4f56-a04c-7476661e2e54 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:54.312380 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 45/92] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:50:53 2022] GET /identity/v3/projects/f868b361cbe341f981c4c6441e332398 => generated 298 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:54.321713 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b322c-0bca-4f56-a04c-7476661e2e54 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:54.326066 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:54.384925 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fee47588-ad17-477f-bbf1-d9d17af4a5ae None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:54.424439 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6b813-8665-4d72-bcd0-668102964355 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:54.424900 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6b813-8665-4d72-bcd0-668102964355 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:54.427045 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6b813-8665-4d72-bcd0-668102964355 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:54.427337 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62e6b813-8665-4d72-bcd0-668102964355 None admin] PATH_INFO: `/v3/projects/18a0a23ab1f24a28a2ea66573b4da46e` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:54.429447 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6b813-8665-4d72-bcd0-668102964355 None admin] RBAC: Authorizing `identity:get_project(project_id=18a0a23ab1f24a28a2ea66573b4da46e)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:54.431008 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62e6b813-8665-4d72-bcd0-668102964355 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:54.433767 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 48/93] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:50:54 2022] GET /identity/v3/projects/18a0a23ab1f24a28a2ea66573b4da46e => generated 312 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:54.442890 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6b813-8665-4d72-bcd0-668102964355 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:54.469110 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:54.529580 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326b322c-0bca-4f56-a04c-7476661e2e54 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:54.574520 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ee9f0-598d-4eac-b69e-c1d24e2fe959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:54.575842 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ee9f0-598d-4eac-b69e-c1d24e2fe959 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:54.576355 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ee9f0-598d-4eac-b69e-c1d24e2fe959 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:54.576825 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab5ee9f0-598d-4eac-b69e-c1d24e2fe959 None admin] PATH_INFO: `/v3/projects/f868b361cbe341f981c4c6441e332398` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:54.578489 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ee9f0-598d-4eac-b69e-c1d24e2fe959 None admin] RBAC: Authorizing `identity:get_project(project_id=f868b361cbe341f981c4c6441e332398)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:54.580202 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab5ee9f0-598d-4eac-b69e-c1d24e2fe959 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:54.583288 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 46/94] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:50:54 2022] GET /identity/v3/projects/f868b361cbe341f981c4c6441e332398 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:54.584950 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ee9f0-598d-4eac-b69e-c1d24e2fe959 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:54.796640 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62e6b813-8665-4d72-bcd0-668102964355 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:54.855191 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:54.916712 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab5ee9f0-598d-4eac-b69e-c1d24e2fe959 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:54.919549 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d4bf7-b963-425f-abfd-bc936db60f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:54.920740 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d4bf7-b963-425f-abfd-bc936db60f3c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:54.921228 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d4bf7-b963-425f-abfd-bc936db60f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:54.921688 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705d4bf7-b963-425f-abfd-bc936db60f3c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:54.923036 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d4bf7-b963-425f-abfd-bc936db60f3c None admin] RBAC: Adding query filter params (role.id=c73e9539582145ed8eedc48648b9d738, scope.project.id=f868b361cbe341f981c4c6441e332398, user.id=bab4a9bddb7141a48bb694677f33efcc) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:50:54.923563 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d4bf7-b963-425f-abfd-bc936db60f3c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:54.926460 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705d4bf7-b963-425f-abfd-bc936db60f3c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:54.948452 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 49/95] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:50:54 2022] GET /identity/v3/role_assignments?user.id=bab4a9bddb7141a48bb694677f33efcc&scope.project.id=f868b361cbe341f981c4c6441e332398&role.id=c73e9539582145ed8eedc48648b9d738 => generated 259 bytes in 507 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:54.949723 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d4bf7-b963-425f-abfd-bc936db60f3c None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:55.000422 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:55.028118 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c497fe4c-1029-43a1-baa8-2e224e1e9208 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:55.028754 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497fe4c-1029-43a1-baa8-2e224e1e9208 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:55.029060 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497fe4c-1029-43a1-baa8-2e224e1e9208 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:55.029326 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c497fe4c-1029-43a1-baa8-2e224e1e9208 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:55.030089 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c497fe4c-1029-43a1-baa8-2e224e1e9208 None admin] RBAC: Adding query filter params (role.id=54545d831b9e469dad64f2d28c12e462, scope.project.id=18a0a23ab1f24a28a2ea66573b4da46e, user.id=5964ab09eab9453db0a9316d1da8e974) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:50:55.030397 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c497fe4c-1029-43a1-baa8-2e224e1e9208 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:55.031944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c497fe4c-1029-43a1-baa8-2e224e1e9208 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:55.047574 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 47/96] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:50:54 2022] GET /identity/v3/role_assignments?user.id=5964ab09eab9453db0a9316d1da8e974&scope.project.id=18a0a23ab1f24a28a2ea66573b4da46e&role.id=54545d831b9e469dad64f2d28c12e462 => generated 259 bytes in 463 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:55.154695 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705d4bf7-b963-425f-abfd-bc936db60f3c None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:55.210495 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-204ecc1c-cd10-4466-967d-18bcadb7587e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:55.211734 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ecc1c-cd10-4466-967d-18bcadb7587e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:55.212374 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ecc1c-cd10-4466-967d-18bcadb7587e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:55.212998 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-204ecc1c-cd10-4466-967d-18bcadb7587e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:55.214176 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ecc1c-cd10-4466-967d-18bcadb7587e None admin] RBAC: Adding query filter params (role.id=f186b24dc4eb43668f180c85b7c1fc20, scope.project.id=f868b361cbe341f981c4c6441e332398, user.id=5964ab09eab9453db0a9316d1da8e974) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:50:55.214894 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ecc1c-cd10-4466-967d-18bcadb7587e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:55.216873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-204ecc1c-cd10-4466-967d-18bcadb7587e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:55.233188 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 50/97] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:50:54 2022] GET /identity/v3/role_assignments?user.id=5964ab09eab9453db0a9316d1da8e974&scope.project.id=f868b361cbe341f981c4c6441e332398&role.id=f186b24dc4eb43668f180c85b7c1fc20 => generated 259 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:56.098603 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49a2d6-ba7c-43e8-bee6-6ba2536d1df2 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:56.099380 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49a2d6-ba7c-43e8-bee6-6ba2536d1df2 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:56.099380 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b49a2d6-ba7c-43e8-bee6-6ba2536d1df2 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:56.100512 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 48/98] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:56.115007 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74bb70-9fec-438a-89a1-fb38ab8e4340 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:56.115709 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74bb70-9fec-438a-89a1-fb38ab8e4340 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:56.115709 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e74bb70-9fec-438a-89a1-fb38ab8e4340 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:56.142883 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-3e74bb70-9fec-438a-89a1-fb38ab8e4340 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:56.144111 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-3e74bb70-9fec-438a-89a1-fb38ab8e4340 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:56.198369 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:56.241113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 51/99] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:50:56.772452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49a2d6-ba7c-43e8-bee6-6ba2536d1df2 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:56.852705 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac1ebf-94f6-41b9-a8f9-5c7c7559b2f6 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:56.853031 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac1ebf-94f6-41b9-a8f9-5c7c7559b2f6 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:56.853417 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ac1ebf-94f6-41b9-a8f9-5c7c7559b2f6 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:56.854758 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 52/100] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:50:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:50:56.864042 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906755d5-9791-4fa1-a30b-cea7238d4dbe None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:56.864451 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906755d5-9791-4fa1-a30b-cea7238d4dbe None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:56.864602 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-906755d5-9791-4fa1-a30b-cea7238d4dbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:56.896047 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-906755d5-9791-4fa1-a30b-cea7238d4dbe None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:56.897298 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-906755d5-9791-4fa1-a30b-cea7238d4dbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:57.026384 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b49a2d6-ba7c-43e8-bee6-6ba2536d1df2 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:57.041808 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 53/101] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:50:57.121273 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb484f-84f0-4b59-abb8-0791f23a8a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:57.122388 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb484f-84f0-4b59-abb8-0791f23a8a71 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:57.122874 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb484f-84f0-4b59-abb8-0791f23a8a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:57.123357 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4cb484f-84f0-4b59-abb8-0791f23a8a71 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:57.153742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4cb484f-84f0-4b59-abb8-0791f23a8a71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:50:57.163847 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-c4cb484f-84f0-4b59-abb8-0791f23a8a71 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:50:57.163847 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:50:57.163847 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:50:57.163847 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:50:57.163847 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:50:57.163847 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:50:57.163847 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:50:57.163847 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:50:57.163847 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:50:57.163847 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:50:57.163847 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:50:57.163847 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:50:57.163847 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:50:57.163847 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:50:57.163847 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:50:57.163847 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:50:57.165257 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:50:57.165257 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:50:57.165257 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:50:57.165257 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:50:57.165257 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:50:57.165257 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:50:57.165257 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:50:57.165257 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:50:57.165257 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:50:57.165257 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:50:57.165257 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:50:57.165257 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:50:57.165257 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:50:57.165257 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:50:57.165257 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:50:57.165257 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:50:57.166615 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:50:57.166615 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:50:57.166615 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:50:57.166615 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:50:57.166615 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:50:57.166615 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:50:57.166615 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:50:57.166615 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:50:57.166615 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:50:57.166615 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:50:57.166615 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:50:57.166615 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:50:57.166615 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 49/102] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:50:56 2022] GET /identity/v3/roles/reader => generated 84 bytes in 394 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:50:57.174394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906755d5-9791-4fa1-a30b-cea7238d4dbe None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:57.353597 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-906755d5-9791-4fa1-a30b-cea7238d4dbe None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:57.357691 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:57.408621 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbf811-6198-49db-b97e-e9d99e88a5ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:57.409285 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbf811-6198-49db-b97e-e9d99e88a5ad None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:57.409567 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbf811-6198-49db-b97e-e9d99e88a5ad None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:57.409840 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1cbf811-6198-49db-b97e-e9d99e88a5ad None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:57.410522 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbf811-6198-49db-b97e-e9d99e88a5ad None admin] RBAC: Adding query filter params (name=reader) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:50:57.410828 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbf811-6198-49db-b97e-e9d99e88a5ad None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:57.412271 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1cbf811-6198-49db-b97e-e9d99e88a5ad None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:57.422001 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 54/103] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:50:57 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:57.430950 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb484f-84f0-4b59-abb8-0791f23a8a71 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:57.546118 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:57.675953 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4cb484f-84f0-4b59-abb8-0791f23a8a71 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:57.763575 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0240022-9868-4fce-90ca-a20021c0a5e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:57.764501 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0240022-9868-4fce-90ca-a20021c0a5e9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:57.764889 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0240022-9868-4fce-90ca-a20021c0a5e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:57.765358 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0240022-9868-4fce-90ca-a20021c0a5e9 None admin] PATH_INFO: `/v3/users/55d6f2c056514d4e80e5fb74559dcdde` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:57.801267 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0240022-9868-4fce-90ca-a20021c0a5e9 None admin] RBAC: Authorizing `identity:get_user(user_id=55d6f2c056514d4e80e5fb74559dcdde)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:57.803985 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0240022-9868-4fce-90ca-a20021c0a5e9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:57.807054 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 50/104] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:50:57 2022] GET /identity/v3/users/55d6f2c056514d4e80e5fb74559dcdde => generated 289 bytes in 377 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:57.816749 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbf811-6198-49db-b97e-e9d99e88a5ad None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:57.834388 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0240022-9868-4fce-90ca-a20021c0a5e9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:58.130238 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1cbf811-6198-49db-b97e-e9d99e88a5ad None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:58.271674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c54b7903-d918-4a3d-818e-111950e3936c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:58.273443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b7903-d918-4a3d-818e-111950e3936c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:58.273969 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b7903-d918-4a3d-818e-111950e3936c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:58.274469 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c54b7903-d918-4a3d-818e-111950e3936c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:58.284347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0240022-9868-4fce-90ca-a20021c0a5e9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:58.313768 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:58.353744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:58.411161 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b7903-d918-4a3d-818e-111950e3936c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:58.414482 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c54b7903-d918-4a3d-818e-111950e3936c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:58.463289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f4a1434-b181-4f37-b024-c0f19961b978 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:58.464484 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a1434-b181-4f37-b024-c0f19961b978 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:58.464989 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a1434-b181-4f37-b024-c0f19961b978 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:58.465518 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f4a1434-b181-4f37-b024-c0f19961b978 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:58.467877 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a1434-b181-4f37-b024-c0f19961b978 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:58.470591 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f4a1434-b181-4f37-b024-c0f19961b978 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:58.483788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 51/105] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:50:57 2022] GET /identity/v3/domains/default => generated 199 bytes in 650 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:50:58.486053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052e9cf-656b-4d45-b571-2dee71c703a1 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:58.486541 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052e9cf-656b-4d45-b571-2dee71c703a1 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:58.487029 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d052e9cf-656b-4d45-b571-2dee71c703a1 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:58.502753 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 52/106] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:50:58 2022] GET /identity => generated 270 bytes in 19 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:58.504289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052e9cf-656b-4d45-b571-2dee71c703a1 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:58.572766 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 55/107] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:50:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 757 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:50:58.575906 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15b1c2-299c-454b-a438-cc944079cd38 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:58.576445 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15b1c2-299c-454b-a438-cc944079cd38 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:58.576939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d15b1c2-299c-454b-a438-cc944079cd38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:58.600635 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-3d15b1c2-299c-454b-a438-cc944079cd38 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:58.603177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-3d15b1c2-299c-454b-a438-cc944079cd38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:58.686476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:58.697715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 56/108] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:58 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:50:58.699834 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15b1c2-299c-454b-a438-cc944079cd38 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:58.847205 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d15b1c2-299c-454b-a438-cc944079cd38 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:58.895973 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659fdbf-967d-4027-a8a8-4046721d1791 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:58.897197 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659fdbf-967d-4027-a8a8-4046721d1791 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:58.898799 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659fdbf-967d-4027-a8a8-4046721d1791 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:58.899532 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c659fdbf-967d-4027-a8a8-4046721d1791 None admin] PATH_INFO: `/v3/projects/f868b361cbe341f981c4c6441e332398` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:58.901580 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659fdbf-967d-4027-a8a8-4046721d1791 None admin] RBAC: Authorizing `identity:get_project(project_id=f868b361cbe341f981c4c6441e332398)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:58.903771 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c659fdbf-967d-4027-a8a8-4046721d1791 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:58.907454 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 57/109] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:50:58 2022] GET /identity/v3/projects/f868b361cbe341f981c4c6441e332398 => generated 298 bytes in 209 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:58.921177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659fdbf-967d-4027-a8a8-4046721d1791 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:59.014211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d052e9cf-656b-4d45-b571-2dee71c703a1 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:59.021616 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:59.080786 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c659fdbf-967d-4027-a8a8-4046721d1791 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:59.161369 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd8a300f-70a7-40fe-8519-c7974ae865fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:59.162455 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a300f-70a7-40fe-8519-c7974ae865fe None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:59.162922 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a300f-70a7-40fe-8519-c7974ae865fe None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:59.163379 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd8a300f-70a7-40fe-8519-c7974ae865fe None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:59.164785 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a300f-70a7-40fe-8519-c7974ae865fe None admin] RBAC: Adding query filter params (role.id=3ad6ad0ef7dd4a94be313f7b1074a82e, scope.project.id=f868b361cbe341f981c4c6441e332398, user.id=55d6f2c056514d4e80e5fb74559dcdde) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:50:59.165369 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a300f-70a7-40fe-8519-c7974ae865fe None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:59.166247 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-504b1679-7c62-4606-a64d-aded4a0a780a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:59.167125 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b1679-7c62-4606-a64d-aded4a0a780a None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:59.167700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b1679-7c62-4606-a64d-aded4a0a780a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:59.168189 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-504b1679-7c62-4606-a64d-aded4a0a780a None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:59.168346 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd8a300f-70a7-40fe-8519-c7974ae865fe None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:59.169481 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b1679-7c62-4606-a64d-aded4a0a780a None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:59.177081 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-504b1679-7c62-4606-a64d-aded4a0a780a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:59.180308 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 58/110] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:50:58 2022] GET /identity/v3/role_assignments?user.id=55d6f2c056514d4e80e5fb74559dcdde&scope.project.id=f868b361cbe341f981c4c6441e332398&role.id=3ad6ad0ef7dd4a94be313f7b1074a82e => generated 259 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:50:59.185077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77b2e1-456e-4e27-a2a6-7afa2c0bccc2 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:59.185077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77b2e1-456e-4e27-a2a6-7afa2c0bccc2 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:59.185077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b77b2e1-456e-4e27-a2a6-7afa2c0bccc2 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:59.186087 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 59/111] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:50:59 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:50:59.195824 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d13f0a-b35c-4639-9383-f47766dc3d89 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:59.196335 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d13f0a-b35c-4639-9383-f47766dc3d89 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:59.196844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08d13f0a-b35c-4639-9383-f47766dc3d89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:59.241395 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 53/112] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 21 00:50:58 2022] POST /identity/v3/projects => generated 302 bytes in 738 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:50:59.242557 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-08d13f0a-b35c-4639-9383-f47766dc3d89 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:59.247044 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-08d13f0a-b35c-4639-9383-f47766dc3d89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:59.329465 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7b71b-bf12-4e1e-a689-86009a64d6ad None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:59.330733 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7b71b-bf12-4e1e-a689-86009a64d6ad None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:59.331250 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09a7b71b-bf12-4e1e-a689-86009a64d6ad None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:59.334357 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 54/113] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:50:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:50:59.342113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec8dce-29bc-49fa-b470-409f8d7e2982 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:59.343889 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec8dce-29bc-49fa-b470-409f8d7e2982 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:59.344457 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eec8dce-29bc-49fa-b470-409f8d7e2982 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:59.369590 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-1eec8dce-29bc-49fa-b470-409f8d7e2982 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:50:59.372074 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1eec8dce-29bc-49fa-b470-409f8d7e2982 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:50:59.404952 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:59.421846 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 60/114] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:50:59.423677 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d13f0a-b35c-4639-9383-f47766dc3d89 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:59.504771 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:50:59.556538 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 55/115] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:50:59 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:50:59.603725 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08d13f0a-b35c-4639-9383-f47766dc3d89 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:59.695065 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c0a70-73b6-4000-b69d-098a0dbec170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:59.696743 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c0a70-73b6-4000-b69d-098a0dbec170 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:59.697814 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c0a70-73b6-4000-b69d-098a0dbec170 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:59.698622 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-035c0a70-73b6-4000-b69d-098a0dbec170 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:59.719913 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-035c0a70-73b6-4000-b69d-098a0dbec170 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:50:59.730159 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-035c0a70-73b6-4000-b69d-098a0dbec170 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:50:59.730159 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:50:59.730159 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:50:59.730159 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:50:59.730159 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:50:59.730159 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:50:59.730159 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:50:59.730159 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:50:59.730159 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:50:59.730159 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:50:59.730159 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:50:59.730159 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:50:59.730159 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:50:59.730159 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:50:59.730159 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:50:59.730159 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:50:59.731778 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:50:59.731778 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:50:59.731778 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:50:59.731778 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:50:59.731778 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:50:59.731778 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:50:59.731778 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:50:59.731778 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:50:59.731778 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:50:59.731778 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:50:59.731778 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:50:59.731778 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:50:59.731778 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:50:59.731778 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:50:59.731778 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:50:59.731778 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:50:59.733310 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:50:59.733310 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:50:59.733310 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:50:59.733310 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:50:59.733310 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:50:59.733310 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:50:59.733310 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:50:59.733310 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:50:59.733310 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:50:59.733310 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:50:59.733310 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:50:59.733310 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:50:59.737621 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 61/116] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:50:59 2022] GET /identity/v3/roles/member => generated 84 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:50:59.746871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec8dce-29bc-49fa-b470-409f8d7e2982 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:59.905649 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eec8dce-29bc-49fa-b470-409f8d7e2982 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:50:59.949469 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d78902-1e9e-4470-ac74-b04097f78c56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:50:59.950249 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d78902-1e9e-4470-ac74-b04097f78c56 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:50:59.950540 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d78902-1e9e-4470-ac74-b04097f78c56 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:50:59.950975 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7d78902-1e9e-4470-ac74-b04097f78c56 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:50:59.951876 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d78902-1e9e-4470-ac74-b04097f78c56 None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:50:59.952190 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d78902-1e9e-4470-ac74-b04097f78c56 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:50:59.953662 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7d78902-1e9e-4470-ac74-b04097f78c56 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:50:59.965196 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 56/117] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:50:59 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:50:59.971675 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c0a70-73b6-4000-b69d-098a0dbec170 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:50:59.973247 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d78902-1e9e-4470-ac74-b04097f78c56 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:00.002999 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:00.170517 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7d78902-1e9e-4470-ac74-b04097f78c56 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:00.272433 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-035c0a70-73b6-4000-b69d-098a0dbec170 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:00.290473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eaa5e314-ea19-43d7-a347-0d41b8366e18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:00.292060 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5e314-ea19-43d7-a347-0d41b8366e18 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:00.292832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5e314-ea19-43d7-a347-0d41b8366e18 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:00.293620 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eaa5e314-ea19-43d7-a347-0d41b8366e18 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:00.299182 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:00.314426 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eaa5e314-ea19-43d7-a347-0d41b8366e18 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:00.317429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd90f01-c585-471c-9eb1-e6241b669070 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:00.318087 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd90f01-c585-471c-9eb1-e6241b669070 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:00.318372 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd90f01-c585-471c-9eb1-e6241b669070 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:00.318649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ffd90f01-c585-471c-9eb1-e6241b669070 None admin] PATH_INFO: `/v3/users/5964ab09eab9453db0a9316d1da8e974` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:00.319905 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd90f01-c585-471c-9eb1-e6241b669070 None admin] RBAC: Authorizing `identity:get_user(user_id=5964ab09eab9453db0a9316d1da8e974)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:00.321472 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ffd90f01-c585-471c-9eb1-e6241b669070 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:00.323139 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 62/118] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:50:59 2022] GET /identity/v3/users/5964ab09eab9453db0a9316d1da8e974 => generated 275 bytes in 352 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:00.326844 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-eaa5e314-ea19-43d7-a347-0d41b8366e18 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:00.326844 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:00.326844 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:00.326844 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:00.326844 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:00.326844 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:00.326844 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:00.326844 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:00.326844 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:00.326844 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:00.326844 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:00.326844 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:00.326844 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:00.326844 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:00.326844 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:00.326844 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:00.328345 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:00.328345 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:00.328345 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:00.328345 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:00.328345 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:00.328345 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:00.328345 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:00.328345 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:00.328345 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:00.328345 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:00.328345 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:00.328345 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:00.328345 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:00.328345 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:00.328345 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:00.328345 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:00.330814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:00.330814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:00.330814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:00.330814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:00.330814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:00.330814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:00.330814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:00.330814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:00.330814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:00.330814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:00.330814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:00.330814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:51:00.331734 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd90f01-c585-471c-9eb1-e6241b669070 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:00.334628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 57/119] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:50:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 362 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:00.337139 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b18b9-864a-458e-969b-011cc7e986f7 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:00.337680 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b18b9-864a-458e-969b-011cc7e986f7 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:00.338202 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49b18b9-864a-458e-969b-011cc7e986f7 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:00.340688 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 58/120] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:00.347932 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b18b9-864a-458e-969b-011cc7e986f7 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:00.495352 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:00.495812 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ffd90f01-c585-471c-9eb1-e6241b669070 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:00.540953 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49b18b9-864a-458e-969b-011cc7e986f7 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:00.558669 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d709e1e-d50f-437b-9ada-223929932920 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:00.560229 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d709e1e-d50f-437b-9ada-223929932920 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:00.560859 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d709e1e-d50f-437b-9ada-223929932920 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:00.561318 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d709e1e-d50f-437b-9ada-223929932920 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:00.578383 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d709e1e-d50f-437b-9ada-223929932920 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:00.585505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-5d709e1e-d50f-437b-9ada-223929932920 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:00.585505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:00.585505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:00.585505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:00.585505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:00.585505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:00.585505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:00.585505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:00.585505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:00.585505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:00.585505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:00.585505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:00.585505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:00.585505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:00.585505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:00.585505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:00.586760 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:00.586760 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:00.586760 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:00.586760 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:00.586760 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:00.586760 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:00.586760 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:00.586760 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:00.586760 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:00.586760 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:00.586760 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:00.586760 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:00.586760 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:00.586760 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:00.586760 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:00.586760 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:00.587944 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:00.587944 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:00.587944 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:00.587944 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:00.587944 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:00.587944 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:00.587944 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:00.587944 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:00.587944 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:00.587944 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:00.587944 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:00.587944 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:00.590608 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 63/121] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:00 2022] GET /identity/v3/roles/member => generated 84 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:00.592093 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d709e1e-d50f-437b-9ada-223929932920 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:00.627912 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c80c6cb4-8ac5-4626-bd8f-d3ec18398695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:00.629404 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c6cb4-8ac5-4626-bd8f-d3ec18398695 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:00.629904 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c6cb4-8ac5-4626-bd8f-d3ec18398695 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:00.630443 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c80c6cb4-8ac5-4626-bd8f-d3ec18398695 None admin] PATH_INFO: `/v3/projects/f868b361cbe341f981c4c6441e332398` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:00.632745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c6cb4-8ac5-4626-bd8f-d3ec18398695 None admin] RBAC: Authorizing `identity:get_project(project_id=f868b361cbe341f981c4c6441e332398)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:00.636066 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c80c6cb4-8ac5-4626-bd8f-d3ec18398695 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:00.641115 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 59/122] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:00 2022] GET /identity/v3/projects/f868b361cbe341f981c4c6441e332398 => generated 298 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:00.642507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12e009-7929-4401-808b-0483872d638b None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:00.642956 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12e009-7929-4401-808b-0483872d638b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:00.643382 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e12e009-7929-4401-808b-0483872d638b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:00.669992 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:00.678836 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-1e12e009-7929-4401-808b-0483872d638b None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:00.681281 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1e12e009-7929-4401-808b-0483872d638b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:00.743308 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d709e1e-d50f-437b-9ada-223929932920 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:00.792597 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f0542-c6a6-450f-984f-8bdfb899a944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:00.793246 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f0542-c6a6-450f-984f-8bdfb899a944 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:00.793532 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f0542-c6a6-450f-984f-8bdfb899a944 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:00.793811 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c51f0542-c6a6-450f-984f-8bdfb899a944 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:00.794508 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f0542-c6a6-450f-984f-8bdfb899a944 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:00.794815 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f0542-c6a6-450f-984f-8bdfb899a944 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:00.796410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c51f0542-c6a6-450f-984f-8bdfb899a944 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:00.807174 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 64/123] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:00 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:00.807920 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f0542-c6a6-450f-984f-8bdfb899a944 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:00.831001 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 60/124] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 190 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:00.839350 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12e009-7929-4401-808b-0483872d638b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:00.946195 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c51f0542-c6a6-450f-984f-8bdfb899a944 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:00.958270 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:01.011274 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e9516-719f-490a-a7ce-253481b7c4af None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:01.012348 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e9516-719f-490a-a7ce-253481b7c4af None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:01.012846 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e9516-719f-490a-a7ce-253481b7c4af None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:01.013369 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db8e9516-719f-490a-a7ce-253481b7c4af None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:01.014583 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e9516-719f-490a-a7ce-253481b7c4af None admin] RBAC: Adding query filter params (name=member) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:01.015114 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e9516-719f-490a-a7ce-253481b7c4af None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:01.017840 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db8e9516-719f-490a-a7ce-253481b7c4af None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:01.043330 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:01.051318 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 65/125] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:00 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:01.053733 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e9516-719f-490a-a7ce-253481b7c4af None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:01.096436 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e12e009-7929-4401-808b-0483872d638b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:01.155020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae0e49-fc5a-40f3-b71e-7a836bf2cd10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:01.155948 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae0e49-fc5a-40f3-b71e-7a836bf2cd10 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:01.156384 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae0e49-fc5a-40f3-b71e-7a836bf2cd10 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:01.156666 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dae0e49-fc5a-40f3-b71e-7a836bf2cd10 None admin] PATH_INFO: `/v3/projects/f868b361cbe341f981c4c6441e332398/users/5964ab09eab9453db0a9316d1da8e974/roles/54545d831b9e469dad64f2d28c12e462` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:01.159550 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae0e49-fc5a-40f3-b71e-7a836bf2cd10 None admin] RBAC: Authorizing `identity:create_grant(project_id=f868b361cbe341f981c4c6441e332398, user_id=5964ab09eab9453db0a9316d1da8e974, role_id=54545d831b9e469dad64f2d28c12e462)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:01.161163 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dae0e49-fc5a-40f3-b71e-7a836bf2cd10 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:01.179403 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 61/126] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 21 00:51:00 2022] PUT /identity/v3/projects/f868b361cbe341f981c4c6441e332398/users/5964ab09eab9453db0a9316d1da8e974/roles/54545d831b9e469dad64f2d28c12e462 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:01.181868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae0e49-fc5a-40f3-b71e-7a836bf2cd10 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:01.299727 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db8e9516-719f-490a-a7ce-253481b7c4af None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:01.364219 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dae0e49-fc5a-40f3-b71e-7a836bf2cd10 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:01.395791 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2086a-1067-4351-8e98-2427e0ef9c55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:01.396847 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2086a-1067-4351-8e98-2427e0ef9c55 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:01.397352 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2086a-1067-4351-8e98-2427e0ef9c55 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:01.397821 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ee2086a-1067-4351-8e98-2427e0ef9c55 None admin] PATH_INFO: `/v3/users/bab4a9bddb7141a48bb694677f33efcc` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:01.399897 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2086a-1067-4351-8e98-2427e0ef9c55 None admin] RBAC: Authorizing `identity:get_user(user_id=bab4a9bddb7141a48bb694677f33efcc)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:01.402706 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ee2086a-1067-4351-8e98-2427e0ef9c55 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:01.413910 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 66/127] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:01 2022] GET /identity/v3/users/bab4a9bddb7141a48bb694677f33efcc => generated 247 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:01.422447 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2086a-1067-4351-8e98-2427e0ef9c55 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:01.422918 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad780bc3-929b-4283-ae81-94c155889347 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:01.423828 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad780bc3-929b-4283-ae81-94c155889347 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:01.424242 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad780bc3-929b-4283-ae81-94c155889347 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:01.424643 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad780bc3-929b-4283-ae81-94c155889347 None admin] PATH_INFO: `/v3/users/5964ab09eab9453db0a9316d1da8e974` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:01.426645 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad780bc3-929b-4283-ae81-94c155889347 None admin] RBAC: Authorizing `identity:get_user(user_id=5964ab09eab9453db0a9316d1da8e974)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:01.428981 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad780bc3-929b-4283-ae81-94c155889347 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:01.431007 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 62/128] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:01 2022] GET /identity/v3/users/5964ab09eab9453db0a9316d1da8e974 => generated 275 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:01.438546 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad780bc3-929b-4283-ae81-94c155889347 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:01.441953 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:01.547303 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:01.596387 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad780bc3-929b-4283-ae81-94c155889347 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:01.647601 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e14f86-dd7d-4e83-b60e-9801ad1ebe09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:01.648597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e14f86-dd7d-4e83-b60e-9801ad1ebe09 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:01.649080 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e14f86-dd7d-4e83-b60e-9801ad1ebe09 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:01.649533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e14f86-dd7d-4e83-b60e-9801ad1ebe09 None admin] PATH_INFO: `/v3/projects/18a0a23ab1f24a28a2ea66573b4da46e` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:01.651136 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e14f86-dd7d-4e83-b60e-9801ad1ebe09 None admin] RBAC: Authorizing `identity:get_project(project_id=18a0a23ab1f24a28a2ea66573b4da46e)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:01.653162 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-37e14f86-dd7d-4e83-b60e-9801ad1ebe09 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:01.655173 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 63/129] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:01 2022] GET /identity/v3/projects/18a0a23ab1f24a28a2ea66573b4da46e => generated 312 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:01.656908 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e14f86-dd7d-4e83-b60e-9801ad1ebe09 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:01.702587 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ee2086a-1067-4351-8e98-2427e0ef9c55 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:01.770780 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c042146-e39a-4aa0-ab3a-c2a4eb28089e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:01.772329 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c042146-e39a-4aa0-ab3a-c2a4eb28089e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:01.772856 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c042146-e39a-4aa0-ab3a-c2a4eb28089e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:01.773365 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c042146-e39a-4aa0-ab3a-c2a4eb28089e None admin] PATH_INFO: `/v3/projects/f868b361cbe341f981c4c6441e332398` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:01.776130 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c042146-e39a-4aa0-ab3a-c2a4eb28089e None admin] RBAC: Authorizing `identity:get_project(project_id=f868b361cbe341f981c4c6441e332398)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:01.778462 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7c042146-e39a-4aa0-ab3a-c2a4eb28089e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:01.782094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 67/130] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:01 2022] GET /identity/v3/projects/f868b361cbe341f981c4c6441e332398 => generated 298 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:01.783659 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c042146-e39a-4aa0-ab3a-c2a4eb28089e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:01.798189 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:01.874732 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-37e14f86-dd7d-4e83-b60e-9801ad1ebe09 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:01.966634 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1e228-5762-41f8-a0c9-2d803f8503a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:01.968075 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1e228-5762-41f8-a0c9-2d803f8503a5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:01.968795 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1e228-5762-41f8-a0c9-2d803f8503a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:01.969426 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ece1e228-5762-41f8-a0c9-2d803f8503a5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:01.986615 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ece1e228-5762-41f8-a0c9-2d803f8503a5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:01.993835 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ece1e228-5762-41f8-a0c9-2d803f8503a5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:01.993835 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:01.993835 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:01.993835 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:01.993835 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:01.993835 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:01.993835 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:01.993835 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:01.993835 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:01.993835 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:01.993835 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:01.993835 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:01.993835 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:01.993835 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:01.993835 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:01.993835 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:01.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:01.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:01.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:01.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:01.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:01.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:01.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:01.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:01.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:01.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:01.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:01.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:01.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:01.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:01.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:01.994871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:01.995631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:01.995631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:01.995631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:01.995631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:01.995631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:01.995631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:01.995631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:01.995631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:01.995631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:01.995631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:01.995631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:01.995631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:51:01.999105 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 64/131] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 21 00:51:01 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:02.001309 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1e228-5762-41f8-a0c9-2d803f8503a5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:02.033355 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c042146-e39a-4aa0-ab3a-c2a4eb28089e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:02.058146 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:02.135471 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febb67d-c9c0-4f1a-8460-f631e051d4bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:02.136137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febb67d-c9c0-4f1a-8460-f631e051d4bf None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:02.136502 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febb67d-c9c0-4f1a-8460-f631e051d4bf None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:02.136784 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5febb67d-c9c0-4f1a-8460-f631e051d4bf None admin] PATH_INFO: `/v3/projects/18a0a23ab1f24a28a2ea66573b4da46e/users/5964ab09eab9453db0a9316d1da8e974/roles/54545d831b9e469dad64f2d28c12e462` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:02.142125 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febb67d-c9c0-4f1a-8460-f631e051d4bf None admin] RBAC: Authorizing `identity:create_grant(project_id=18a0a23ab1f24a28a2ea66573b4da46e, user_id=5964ab09eab9453db0a9316d1da8e974, role_id=54545d831b9e469dad64f2d28c12e462)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:02.144992 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5febb67d-c9c0-4f1a-8460-f631e051d4bf None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:02.193387 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 68/132] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 21 00:51:01 2022] PUT /identity/v3/projects/18a0a23ab1f24a28a2ea66573b4da46e/users/5964ab09eab9453db0a9316d1da8e974/roles/54545d831b9e469dad64f2d28c12e462 => generated 0 bytes in 410 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:02.194955 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febb67d-c9c0-4f1a-8460-f631e051d4bf None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:02.344085 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ece1e228-5762-41f8-a0c9-2d803f8503a5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:02.402664 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5febb67d-c9c0-4f1a-8460-f631e051d4bf None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:02.436193 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:02.456038 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56faab84-cb20-4962-9260-4a69dcc9516e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:02.456964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56faab84-cb20-4962-9260-4a69dcc9516e None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:02.457473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56faab84-cb20-4962-9260-4a69dcc9516e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:02.457847 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56faab84-cb20-4962-9260-4a69dcc9516e None admin] PATH_INFO: `/v3/projects/f868b361cbe341f981c4c6441e332398/users/bab4a9bddb7141a48bb694677f33efcc/roles/c73e9539582145ed8eedc48648b9d738` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:02.458891 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc447e-afe0-4777-8793-eb22993f3d90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:02.459795 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc447e-afe0-4777-8793-eb22993f3d90 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:02.460289 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc447e-afe0-4777-8793-eb22993f3d90 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:02.460776 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81bc447e-afe0-4777-8793-eb22993f3d90 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:02.461009 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56faab84-cb20-4962-9260-4a69dcc9516e None admin] RBAC: Authorizing `identity:create_grant(project_id=f868b361cbe341f981c4c6441e332398, user_id=bab4a9bddb7141a48bb694677f33efcc, role_id=c73e9539582145ed8eedc48648b9d738)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:02.461867 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc447e-afe0-4777-8793-eb22993f3d90 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:02.462350 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc447e-afe0-4777-8793-eb22993f3d90 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:02.462811 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56faab84-cb20-4962-9260-4a69dcc9516e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:02.464207 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81bc447e-afe0-4777-8793-eb22993f3d90 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:02.475061 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 69/133] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:51:02 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:02.488132 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc447e-afe0-4777-8793-eb22993f3d90 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:02.492998 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 65/134] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 21 00:51:01 2022] PUT /identity/v3/projects/f868b361cbe341f981c4c6441e332398/users/bab4a9bddb7141a48bb694677f33efcc/roles/c73e9539582145ed8eedc48648b9d738 => generated 0 bytes in 493 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:02.560410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:02.727702 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81bc447e-afe0-4777-8793-eb22993f3d90 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:02.735740 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62edca2-f829-491e-840f-8c0b3cd2594f None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:02.736694 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62edca2-f829-491e-840f-8c0b3cd2594f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:02.737479 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b62edca2-f829-491e-840f-8c0b3cd2594f None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:02.740581 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 66/135] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:02 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:51:02.751718 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a125c8-9d41-4387-a204-3dcc97e31019 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:02.753592 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a125c8-9d41-4387-a204-3dcc97e31019 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:02.754411 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36a125c8-9d41-4387-a204-3dcc97e31019 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:02.796377 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-36a125c8-9d41-4387-a204-3dcc97e31019 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:02.799553 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-36a125c8-9d41-4387-a204-3dcc97e31019 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:02.858302 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992a586-d791-42f7-954d-9eab3ba0b2ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:02.859403 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992a586-d791-42f7-954d-9eab3ba0b2ac None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:02.859978 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992a586-d791-42f7-954d-9eab3ba0b2ac None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:02.860398 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8992a586-d791-42f7-954d-9eab3ba0b2ac None admin] PATH_INFO: `/v3/users/5964ab09eab9453db0a9316d1da8e974` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:02.862658 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992a586-d791-42f7-954d-9eab3ba0b2ac None admin] RBAC: Authorizing `identity:get_user(user_id=5964ab09eab9453db0a9316d1da8e974)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:02.865716 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8992a586-d791-42f7-954d-9eab3ba0b2ac None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:02.868938 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 70/136] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:02 2022] GET /identity/v3/users/5964ab09eab9453db0a9316d1da8e974 => generated 275 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:02.878146 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992a586-d791-42f7-954d-9eab3ba0b2ac None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:02.948990 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 67/137] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:03.160816 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:03.177267 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8992a586-d791-42f7-954d-9eab3ba0b2ac None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:03.251051 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3408db-0ab8-41d6-ba6e-d0e7e2c0d295 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:03.252229 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3408db-0ab8-41d6-ba6e-d0e7e2c0d295 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:03.252715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3408db-0ab8-41d6-ba6e-d0e7e2c0d295 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:03.253207 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb3408db-0ab8-41d6-ba6e-d0e7e2c0d295 None admin] PATH_INFO: `/v3/projects/f868b361cbe341f981c4c6441e332398` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:03.255754 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3408db-0ab8-41d6-ba6e-d0e7e2c0d295 None admin] RBAC: Authorizing `identity:get_project(project_id=f868b361cbe341f981c4c6441e332398)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:03.258651 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb3408db-0ab8-41d6-ba6e-d0e7e2c0d295 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:03.262019 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 71/138] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:02 2022] GET /identity/v3/projects/f868b361cbe341f981c4c6441e332398 => generated 298 bytes in 385 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:03.271702 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a125c8-9d41-4387-a204-3dcc97e31019 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:03.498251 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36a125c8-9d41-4387-a204-3dcc97e31019 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:03.541515 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:03.575083 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7d5dc-7107-4805-a93b-6ae232b73267 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:03.576229 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7d5dc-7107-4805-a93b-6ae232b73267 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:03.576719 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7d5dc-7107-4805-a93b-6ae232b73267 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:03.577264 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fe7d5dc-7107-4805-a93b-6ae232b73267 None admin] PATH_INFO: `/v3/projects/f868b361cbe341f981c4c6441e332398/users/5964ab09eab9453db0a9316d1da8e974/roles/f186b24dc4eb43668f180c85b7c1fc20` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:03.580990 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7d5dc-7107-4805-a93b-6ae232b73267 None admin] RBAC: Authorizing `identity:create_grant(project_id=f868b361cbe341f981c4c6441e332398, user_id=5964ab09eab9453db0a9316d1da8e974, role_id=f186b24dc4eb43668f180c85b7c1fc20)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:03.583849 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fe7d5dc-7107-4805-a93b-6ae232b73267 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:03.605611 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3408db-0ab8-41d6-ba6e-d0e7e2c0d295 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:03.628930 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 68/139] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 21 00:51:03 2022] PUT /identity/v3/projects/f868b361cbe341f981c4c6441e332398/users/5964ab09eab9453db0a9316d1da8e974/roles/f186b24dc4eb43668f180c85b7c1fc20 => generated 0 bytes in 358 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:03.780065 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb3408db-0ab8-41d6-ba6e-d0e7e2c0d295 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:03.832622 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc610d80-6d56-494f-8825-b9f8ffd85c5d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:03.833386 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc610d80-6d56-494f-8825-b9f8ffd85c5d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:03.833666 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc610d80-6d56-494f-8825-b9f8ffd85c5d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:03.833939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc610d80-6d56-494f-8825-b9f8ffd85c5d None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:03.855396 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc610d80-6d56-494f-8825-b9f8ffd85c5d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:03.863280 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-cc610d80-6d56-494f-8825-b9f8ffd85c5d None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:03.863280 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:03.863280 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:03.863280 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:03.863280 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:03.863280 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:03.863280 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:03.863280 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:03.863280 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:03.863280 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:03.863280 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:03.863280 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:03.863280 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:03.863280 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:03.863280 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:03.863280 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:03.866542 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:03.866542 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:03.866542 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:03.866542 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:03.866542 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:03.866542 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:03.866542 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:03.866542 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:03.866542 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:03.866542 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:03.866542 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:03.866542 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:03.866542 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:03.866542 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:03.866542 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:03.866542 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:03.869289 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:03.869289 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:03.869289 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:03.869289 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:03.869289 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:03.869289 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:03.869289 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:03.869289 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:03.869289 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:03.869289 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:03.869289 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:03.869289 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:03.869289 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 72/140] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:03 2022] GET /identity/v3/roles/reader => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:51:03.878881 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7d5dc-7107-4805-a93b-6ae232b73267 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:04.030501 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fe7d5dc-7107-4805-a93b-6ae232b73267 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:04.081853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78a568-cbe6-4b91-9e40-933326d81d36 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:04.082494 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78a568-cbe6-4b91-9e40-933326d81d36 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:04.082824 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78a568-cbe6-4b91-9e40-933326d81d36 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:04.083098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc78a568-cbe6-4b91-9e40-933326d81d36 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:04.083872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78a568-cbe6-4b91-9e40-933326d81d36 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:04.084176 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78a568-cbe6-4b91-9e40-933326d81d36 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:04.085679 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc78a568-cbe6-4b91-9e40-933326d81d36 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:04.091238 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b329c-adf5-4b24-a2cc-3df6a9da1044 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:04.091624 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b329c-adf5-4b24-a2cc-3df6a9da1044 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:04.091872 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d92b329c-adf5-4b24-a2cc-3df6a9da1044 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:04.093473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 73/141] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:51:04.100211 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a72d6-030e-4f79-929f-f046ae729f83 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:04.100655 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a72d6-030e-4f79-929f-f046ae729f83 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:04.101145 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b46a72d6-030e-4f79-929f-f046ae729f83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:04.113613 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 69/142] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:03 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:04.134732 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-b46a72d6-030e-4f79-929f-f046ae729f83 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:04.135995 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b46a72d6-030e-4f79-929f-f046ae729f83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:04.139788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78a568-cbe6-4b91-9e40-933326d81d36 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:04.198572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:04.270367 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:04.345349 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 74/143] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:04.394865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc78a568-cbe6-4b91-9e40-933326d81d36 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:04.442935 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c3028-4d79-4e89-987c-657edcefe5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:04.443876 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c3028-4d79-4e89-987c-657edcefe5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:04.444393 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c3028-4d79-4e89-987c-657edcefe5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:04.444860 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-247c3028-4d79-4e89-987c-657edcefe5e1 None admin] PATH_INFO: `/v3/users/55d6f2c056514d4e80e5fb74559dcdde` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:04.446393 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c3028-4d79-4e89-987c-657edcefe5e1 None admin] RBAC: Authorizing `identity:get_user(user_id=55d6f2c056514d4e80e5fb74559dcdde)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:04.447972 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-247c3028-4d79-4e89-987c-657edcefe5e1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:04.450568 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 70/144] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:04 2022] GET /identity/v3/users/55d6f2c056514d4e80e5fb74559dcdde => generated 289 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:04.457897 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a72d6-030e-4f79-929f-f046ae729f83 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:04.641220 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b46a72d6-030e-4f79-929f-f046ae729f83 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:04.714479 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dd081-4ba4-4cc2-932c-5f834f4ce080 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:04.715625 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dd081-4ba4-4cc2-932c-5f834f4ce080 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:04.716121 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dd081-4ba4-4cc2-932c-5f834f4ce080 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:04.716598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc0dd081-4ba4-4cc2-932c-5f834f4ce080 None admin] PATH_INFO: `/v3/projects/f868b361cbe341f981c4c6441e332398` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:04.720343 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0dd081-4ba4-4cc2-932c-5f834f4ce080 None admin] RBAC: Authorizing `identity:get_project(project_id=f868b361cbe341f981c4c6441e332398)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:04.723321 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc0dd081-4ba4-4cc2-932c-5f834f4ce080 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:04.726843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 75/145] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:04 2022] GET /identity/v3/projects/f868b361cbe341f981c4c6441e332398 => generated 298 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:04.733996 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c3028-4d79-4e89-987c-657edcefe5e1 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:04.744504 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dd081-4ba4-4cc2-932c-5f834f4ce080 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:04.796856 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:04.996984 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-247c3028-4d79-4e89-987c-657edcefe5e1 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:04.997935 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc0dd081-4ba4-4cc2-932c-5f834f4ce080 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:05.020303 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:05.073503 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dabee3c7-7372-442f-9532-c263a9645dbd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:05.075033 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c4d2d-e5f0-49eb-8fa1-cc65251069cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:05.076615 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabee3c7-7372-442f-9532-c263a9645dbd None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:05.078128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c4d2d-e5f0-49eb-8fa1-cc65251069cb None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:05.078959 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabee3c7-7372-442f-9532-c263a9645dbd None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:05.079627 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c4d2d-e5f0-49eb-8fa1-cc65251069cb None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:05.080270 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dabee3c7-7372-442f-9532-c263a9645dbd None admin] PATH_INFO: `/v3/projects/f868b361cbe341f981c4c6441e332398/users/55d6f2c056514d4e80e5fb74559dcdde/roles/3ad6ad0ef7dd4a94be313f7b1074a82e` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:05.080934 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d2c4d2d-e5f0-49eb-8fa1-cc65251069cb None admin] PATH_INFO: `/v3/domains/default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:05.085155 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c4d2d-e5f0-49eb-8fa1-cc65251069cb None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:05.088546 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d2c4d2d-e5f0-49eb-8fa1-cc65251069cb None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:05.090402 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabee3c7-7372-442f-9532-c263a9645dbd None admin] RBAC: Authorizing `identity:create_grant(project_id=f868b361cbe341f981c4c6441e332398, user_id=55d6f2c056514d4e80e5fb74559dcdde, role_id=3ad6ad0ef7dd4a94be313f7b1074a82e)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:05.101883 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dabee3c7-7372-442f-9532-c263a9645dbd None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:05.102338 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 76/146] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:51:04 2022] GET /identity/v3/domains/default => generated 199 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:05.114039 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c4d2d-e5f0-49eb-8fa1-cc65251069cb None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:05.134083 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 71/147] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 21 00:51:04 2022] PUT /identity/v3/projects/f868b361cbe341f981c4c6441e332398/users/55d6f2c056514d4e80e5fb74559dcdde/roles/3ad6ad0ef7dd4a94be313f7b1074a82e => generated 0 bytes in 401 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:05.349213 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b45c1-5b6d-4445-8ca4-8b56fdb10779 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:05.349468 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b45c1-5b6d-4445-8ca4-8b56fdb10779 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:05.349810 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a34b45c1-5b6d-4445-8ca4-8b56fdb10779 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:05.351725 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 72/148] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:05 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:51:05.360246 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417cc63-e481-4dc3-9f39-6934b86543e6 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:05.360642 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417cc63-e481-4dc3-9f39-6934b86543e6 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:05.360818 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d417cc63-e481-4dc3-9f39-6934b86543e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:05.396888 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-d417cc63-e481-4dc3-9f39-6934b86543e6 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:05.399151 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d417cc63-e481-4dc3-9f39-6934b86543e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:05.407659 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:05.437232 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d2c4d2d-e5f0-49eb-8fa1-cc65251069cb None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:05.532705 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff30932-7377-40db-9948-dd1deebfb73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:05.533748 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff30932-7377-40db-9948-dd1deebfb73e None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:05.534194 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff30932-7377-40db-9948-dd1deebfb73e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:05.534605 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ff30932-7377-40db-9948-dd1deebfb73e None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:05.535645 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff30932-7377-40db-9948-dd1deebfb73e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:05.537241 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ff30932-7377-40db-9948-dd1deebfb73e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:05.585204 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 77/149] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 21 00:51:05 2022] POST /identity/v3/users => generated 283 bytes in 472 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:51:05.637799 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 73/150] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:05 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 278 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:06.654273 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff30932-7377-40db-9948-dd1deebfb73e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:06.698573 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243001f-e3a7-4380-aae3-e05d211617be None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:06.699417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243001f-e3a7-4380-aae3-e05d211617be None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:06.699745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9243001f-e3a7-4380-aae3-e05d211617be None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:06.702581 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 74/151] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:06.718671 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e799db1-afe3-4c3a-9ab5-3f6292a87783 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:06.719144 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e799db1-afe3-4c3a-9ab5-3f6292a87783 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:06.719600 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e799db1-afe3-4c3a-9ab5-3f6292a87783 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:06.787112 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-6e799db1-afe3-4c3a-9ab5-3f6292a87783 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:06.789210 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6e799db1-afe3-4c3a-9ab5-3f6292a87783 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:06.904867 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ff30932-7377-40db-9948-dd1deebfb73e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:07.003901 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2672cedb-5ca3-49f7-80f3-d9fa3e18a7bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:07.004975 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672cedb-5ca3-49f7-80f3-d9fa3e18a7bd None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:07.005442 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672cedb-5ca3-49f7-80f3-d9fa3e18a7bd None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:07.005875 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2672cedb-5ca3-49f7-80f3-d9fa3e18a7bd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:07.008265 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 75/152] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 291 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:07.031040 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2672cedb-5ca3-49f7-80f3-d9fa3e18a7bd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:07.047736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-2672cedb-5ca3-49f7-80f3-d9fa3e18a7bd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:07.047736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:07.047736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:07.047736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:07.047736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:07.047736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:07.047736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:07.047736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:07.047736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:07.047736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:07.047736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:07.047736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:07.047736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:07.047736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:07.047736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:07.047736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:07.049744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:07.049744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:07.049744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:07.049744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:07.049744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:07.049744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:07.049744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:07.049744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:07.049744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:07.049744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:07.049744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:07.049744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:07.049744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:07.049744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:07.049744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:07.049744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:07.051534 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:07.051534 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:07.051534 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:07.051534 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:07.051534 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:07.051534 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:07.051534 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:07.051534 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:07.051534 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:07.051534 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:07.051534 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:07.051534 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:07.055426 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 78/153] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:06 2022] GET /identity/v3/roles/member => generated 84 bytes in 402 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:07.065155 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e799db1-afe3-4c3a-9ab5-3f6292a87783 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:07.151965 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:07.289367 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815578c-4cac-461c-8757-7f13764f94c3 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:07.289867 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815578c-4cac-461c-8757-7f13764f94c3 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:07.290360 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7815578c-4cac-461c-8757-7f13764f94c3 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:07.293086 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 79/154] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:07 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:07.307425 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d8c31-55d4-46d1-a728-b969b32ea0e1 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:07.308247 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d8c31-55d4-46d1-a728-b969b32ea0e1 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:07.308947 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b2d8c31-55d4-46d1-a728-b969b32ea0e1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:07.319742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e799db1-afe3-4c3a-9ab5-3f6292a87783 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:07.354481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:07.374780 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-9b2d8c31-55d4-46d1-a728-b969b32ea0e1 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:07.377071 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-9b2d8c31-55d4-46d1-a728-b969b32ea0e1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:07.411211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb6f45-57fa-4e75-ab7a-9bc6c2ee6cda None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:07.412235 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb6f45-57fa-4e75-ab7a-9bc6c2ee6cda None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:07.412722 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb6f45-57fa-4e75-ab7a-9bc6c2ee6cda None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:07.413249 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dcb6f45-57fa-4e75-ab7a-9bc6c2ee6cda None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:07.414466 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb6f45-57fa-4e75-ab7a-9bc6c2ee6cda None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:07.415087 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb6f45-57fa-4e75-ab7a-9bc6c2ee6cda None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:07.417855 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4dcb6f45-57fa-4e75-ab7a-9bc6c2ee6cda None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:07.439732 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 76/155] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:07 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 376 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:07.449798 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb6f45-57fa-4e75-ab7a-9bc6c2ee6cda None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:07.619433 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 80/156] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 314 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:07.689765 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:07.702421 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dcb6f45-57fa-4e75-ab7a-9bc6c2ee6cda None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:07.779996 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a21094-e783-45a2-bb9d-f5450fa6d4c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:07.781091 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a21094-e783-45a2-bb9d-f5450fa6d4c2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:07.781516 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a21094-e783-45a2-bb9d-f5450fa6d4c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:07.781914 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a21094-e783-45a2-bb9d-f5450fa6d4c2 None admin] PATH_INFO: `/v3/users/5964ab09eab9453db0a9316d1da8e974` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:07.784969 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a21094-e783-45a2-bb9d-f5450fa6d4c2 None admin] RBAC: Authorizing `identity:get_user(user_id=5964ab09eab9453db0a9316d1da8e974)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:07.787811 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a21094-e783-45a2-bb9d-f5450fa6d4c2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:07.790798 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 77/157] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:07 2022] GET /identity/v3/users/5964ab09eab9453db0a9316d1da8e974 => generated 275 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:07.800133 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d8c31-55d4-46d1-a728-b969b32ea0e1 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:07.847773 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a21094-e783-45a2-bb9d-f5450fa6d4c2 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:08.122735 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a21094-e783-45a2-bb9d-f5450fa6d4c2 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:08.123002 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b2d8c31-55d4-46d1-a728-b969b32ea0e1 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:08.223137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df93e74-e02c-450e-8135-1f8b1876bd2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:08.223667 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df93e74-e02c-450e-8135-1f8b1876bd2f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:08.224599 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df93e74-e02c-450e-8135-1f8b1876bd2f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:08.224599 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7df93e74-e02c-450e-8135-1f8b1876bd2f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:08.236579 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:08.270215 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91e236-27af-4308-a425-96a75c45e18e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:08.271162 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91e236-27af-4308-a425-96a75c45e18e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:08.271558 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91e236-27af-4308-a425-96a75c45e18e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:08.271943 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc91e236-27af-4308-a425-96a75c45e18e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:08.302705 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc91e236-27af-4308-a425-96a75c45e18e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:08.317224 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-cc91e236-27af-4308-a425-96a75c45e18e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:08.317224 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:08.317224 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:08.317224 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:08.317224 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:08.317224 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:08.317224 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:08.317224 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:08.317224 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:08.317224 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:08.317224 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:08.317224 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:08.317224 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:08.317224 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:08.317224 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:08.317224 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:08.319084 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:08.319084 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:08.319084 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:08.319084 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:08.319084 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:08.319084 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:08.319084 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:08.319084 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:08.319084 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:08.319084 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:08.319084 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:08.319084 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:08.319084 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:08.319084 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:08.319084 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:08.319084 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:08.320607 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:08.320607 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:08.320607 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:08.320607 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:08.320607 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:08.320607 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:08.320607 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:08.320607 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:08.320607 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:08.320607 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:08.320607 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:08.320607 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:51:08.325325 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 78/158] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:51:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 478 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:51:08.335058 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91e236-27af-4308-a425-96a75c45e18e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:08.400932 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:08.411959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df93e74-e02c-450e-8135-1f8b1876bd2f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:08.413616 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7df93e74-e02c-450e-8135-1f8b1876bd2f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:08.673167 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc91e236-27af-4308-a425-96a75c45e18e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:08.688450 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 81/159] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:07 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 889 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:08.690313 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df93e74-e02c-450e-8135-1f8b1876bd2f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:08.779718 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b352e-67a3-47f0-a6a8-2ff3c56b7b00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:08.780767 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b352e-67a3-47f0-a6a8-2ff3c56b7b00 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:08.781287 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b352e-67a3-47f0-a6a8-2ff3c56b7b00 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:08.781774 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-929b352e-67a3-47f0-a6a8-2ff3c56b7b00 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:08.783031 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b352e-67a3-47f0-a6a8-2ff3c56b7b00 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:08.783598 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b352e-67a3-47f0-a6a8-2ff3c56b7b00 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:08.785279 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:08.786451 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-929b352e-67a3-47f0-a6a8-2ff3c56b7b00 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:08.819727 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 79/160] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:08 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 486 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:08.821859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b352e-67a3-47f0-a6a8-2ff3c56b7b00 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:08.973910 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7df93e74-e02c-450e-8135-1f8b1876bd2f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:09.058561 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:09.087755 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-929b352e-67a3-47f0-a6a8-2ff3c56b7b00 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:09.115517 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedf81c-cc6f-4585-bc05-9b8f9e521ca8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:09.116619 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedf81c-cc6f-4585-bc05-9b8f9e521ca8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:09.117135 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedf81c-cc6f-4585-bc05-9b8f9e521ca8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:09.117617 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cbedf81c-cc6f-4585-bc05-9b8f9e521ca8 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:09.162207 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cbedf81c-cc6f-4585-bc05-9b8f9e521ca8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:09.172005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-cbedf81c-cc6f-4585-bc05-9b8f9e521ca8 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:09.172005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:09.172005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:09.172005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:09.172005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:09.172005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:09.172005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:09.172005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:09.172005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:09.172005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:09.172005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:09.172005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:09.172005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:09.172005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:09.172005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:09.172005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:09.173715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:09.173715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:09.173715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:09.173715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:09.173715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:09.173715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:09.173715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:09.173715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:09.173715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:09.173715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:09.173715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:09.173715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:09.173715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:09.173715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:09.173715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:09.173715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:09.176033 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:09.176033 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:09.176033 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:09.176033 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:09.176033 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:09.176033 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:09.176033 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:09.176033 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:09.176033 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:09.176033 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:09.176033 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:09.176033 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:09.179169 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 82/161] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:08 2022] GET /identity/v3/roles/member => generated 84 bytes in 490 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:09.180821 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedf81c-cc6f-4585-bc05-9b8f9e521ca8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:09.194530 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d55a98-5567-4944-b9ed-22dd39d4fe1f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:09.195628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d55a98-5567-4944-b9ed-22dd39d4fe1f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:09.196099 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d55a98-5567-4944-b9ed-22dd39d4fe1f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:09.196635 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-13d55a98-5567-4944-b9ed-22dd39d4fe1f None admin] PATH_INFO: `/v3/projects/f868b361cbe341f981c4c6441e332398` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:09.202721 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d55a98-5567-4944-b9ed-22dd39d4fe1f None admin] RBAC: Authorizing `identity:get_project(project_id=f868b361cbe341f981c4c6441e332398)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:09.205420 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-13d55a98-5567-4944-b9ed-22dd39d4fe1f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:09.209137 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 80/162] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:08 2022] GET /identity/v3/projects/f868b361cbe341f981c4c6441e332398 => generated 298 bytes in 388 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:09.210650 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d55a98-5567-4944-b9ed-22dd39d4fe1f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:09.413672 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:09.427453 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cbedf81c-cc6f-4585-bc05-9b8f9e521ca8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:09.504723 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e7546-c0e0-4678-9b79-4f1f411c45f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:09.506335 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e7546-c0e0-4678-9b79-4f1f411c45f5 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:09.507080 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e7546-c0e0-4678-9b79-4f1f411c45f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:09.507839 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-257e7546-c0e0-4678-9b79-4f1f411c45f5 None admin] PATH_INFO: `/v3/users/bab4a9bddb7141a48bb694677f33efcc` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:09.510408 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e7546-c0e0-4678-9b79-4f1f411c45f5 None admin] RBAC: Authorizing `identity:get_user(user_id=bab4a9bddb7141a48bb694677f33efcc)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:09.517765 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-257e7546-c0e0-4678-9b79-4f1f411c45f5 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:09.521557 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 83/163] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:09 2022] GET /identity/v3/users/bab4a9bddb7141a48bb694677f33efcc => generated 247 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:09.523458 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e7546-c0e0-4678-9b79-4f1f411c45f5 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:09.568990 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-13d55a98-5567-4944-b9ed-22dd39d4fe1f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:09.710250 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ee07d-1f2b-4905-b720-a0c1bb1834b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:09.711574 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ee07d-1f2b-4905-b720-a0c1bb1834b8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:09.712221 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ee07d-1f2b-4905-b720-a0c1bb1834b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:09.712843 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b5ee07d-1f2b-4905-b720-a0c1bb1834b8 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:09.714233 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ee07d-1f2b-4905-b720-a0c1bb1834b8 None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:09.715040 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ee07d-1f2b-4905-b720-a0c1bb1834b8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:09.717788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b5ee07d-1f2b-4905-b720-a0c1bb1834b8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:09.743271 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 81/164] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:09 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 533 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:09.745281 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ee07d-1f2b-4905-b720-a0c1bb1834b8 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:09.796074 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:09.828272 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-257e7546-c0e0-4678-9b79-4f1f411c45f5 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:09.920534 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c5ff4-9cbd-4c55-8f1f-f570d0f17178 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:09.921760 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c5ff4-9cbd-4c55-8f1f-f570d0f17178 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:09.922143 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c5ff4-9cbd-4c55-8f1f-f570d0f17178 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:09.922513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a4c5ff4-9cbd-4c55-8f1f-f570d0f17178 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:09.923373 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c5ff4-9cbd-4c55-8f1f-f570d0f17178 None admin] RBAC: Adding query filter params (role.id=54545d831b9e469dad64f2d28c12e462, scope.project.id=f868b361cbe341f981c4c6441e332398, user.id=5964ab09eab9453db0a9316d1da8e974) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:09.923782 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c5ff4-9cbd-4c55-8f1f-f570d0f17178 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:09.929978 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a4c5ff4-9cbd-4c55-8f1f-f570d0f17178 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:09.941089 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 84/165] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:09 2022] GET /identity/v3/role_assignments?user.id=5964ab09eab9453db0a9316d1da8e974&scope.project.id=f868b361cbe341f981c4c6441e332398&role.id=54545d831b9e469dad64f2d28c12e462 => generated 608 bytes in 416 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:09.941089 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c5ff4-9cbd-4c55-8f1f-f570d0f17178 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:10.036129 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:10.119106 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b5ee07d-1f2b-4905-b720-a0c1bb1834b8 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:10.227674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36979966-671d-4d1f-9602-67ca55f09a53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:10.227674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36979966-671d-4d1f-9602-67ca55f09a53 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:10.228062 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36979966-671d-4d1f-9602-67ca55f09a53 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:10.228251 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36979966-671d-4d1f-9602-67ca55f09a53 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:10.238996 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a4c5ff4-9cbd-4c55-8f1f-f570d0f17178 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:10.308932 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b25d7b7-923b-477b-a690-fd1b61e3b77c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:10.310619 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25d7b7-923b-477b-a690-fd1b61e3b77c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:10.311453 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25d7b7-923b-477b-a690-fd1b61e3b77c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:10.312173 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b25d7b7-923b-477b-a690-fd1b61e3b77c None admin] PATH_INFO: `/v3/users/5964ab09eab9453db0a9316d1da8e974` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:10.314688 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25d7b7-923b-477b-a690-fd1b61e3b77c None admin] RBAC: Authorizing `identity:get_user(user_id=5964ab09eab9453db0a9316d1da8e974)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:10.318098 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b25d7b7-923b-477b-a690-fd1b61e3b77c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:10.321862 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 85/166] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:09 2022] GET /identity/v3/users/5964ab09eab9453db0a9316d1da8e974 => generated 275 bytes in 382 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:10.324481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5b1d5-f6fc-41ac-91af-42c74e384efd None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:10.325279 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5b1d5-f6fc-41ac-91af-42c74e384efd None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:10.325981 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20a5b1d5-f6fc-41ac-91af-42c74e384efd None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:10.329177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 86/167] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:10.331747 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e5a11-4103-4880-9050-9145e259e524 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:10.332477 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e5a11-4103-4880-9050-9145e259e524 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:10.333321 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7e5a11-4103-4880-9050-9145e259e524 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:10.336211 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 87/168] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:10 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:10.338067 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e5a11-4103-4880-9050-9145e259e524 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:10.417354 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36979966-671d-4d1f-9602-67ca55f09a53 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:10.420243 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36979966-671d-4d1f-9602-67ca55f09a53 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:10.447440 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:10.554731 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:10.569646 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7e5a11-4103-4880-9050-9145e259e524 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:10.617988 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 82/169] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 874 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:10.620658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098f24d-5047-4522-9b9d-9a33fe6e945d None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:10.621712 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098f24d-5047-4522-9b9d-9a33fe6e945d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:10.622435 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c098f24d-5047-4522-9b9d-9a33fe6e945d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:10.635335 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d33613-9b1b-4a91-9b21-223e9ba495bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:10.636901 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d33613-9b1b-4a91-9b21-223e9ba495bd None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:10.637699 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d33613-9b1b-4a91-9b21-223e9ba495bd None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:10.638278 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50d33613-9b1b-4a91-9b21-223e9ba495bd None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:10.663591 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-c098f24d-5047-4522-9b9d-9a33fe6e945d None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:10.665431 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c098f24d-5047-4522-9b9d-9a33fe6e945d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:10.764941 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d33613-9b1b-4a91-9b21-223e9ba495bd None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:10.767287 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-50d33613-9b1b-4a91-9b21-223e9ba495bd None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:10.847794 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 83/170] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:10.851006 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab83fb-c514-46a7-8850-8cd228e732c8 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:10.851764 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab83fb-c514-46a7-8850-8cd228e732c8 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:10.852533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3ab83fb-c514-46a7-8850-8cd228e732c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:10.890393 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-d3ab83fb-c514-46a7-8850-8cd228e732c8 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:10.892876 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d3ab83fb-c514-46a7-8850-8cd228e732c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:10.901324 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:10.912587 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 88/171] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 575 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:10.914549 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d33613-9b1b-4a91-9b21-223e9ba495bd None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:10.963112 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:11.025378 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 84/172] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:11.027384 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab83fb-c514-46a7-8850-8cd228e732c8 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:11.044734 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50d33613-9b1b-4a91-9b21-223e9ba495bd None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:11.087789 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10edec-330e-48d2-a43d-79c94a21a68a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:11.088797 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10edec-330e-48d2-a43d-79c94a21a68a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:11.089473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10edec-330e-48d2-a43d-79c94a21a68a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:11.089983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b10edec-330e-48d2-a43d-79c94a21a68a None admin] PATH_INFO: `/v3/projects/f868b361cbe341f981c4c6441e332398` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:11.091531 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10edec-330e-48d2-a43d-79c94a21a68a None admin] RBAC: Authorizing `identity:get_project(project_id=f868b361cbe341f981c4c6441e332398)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:11.093301 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b10edec-330e-48d2-a43d-79c94a21a68a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:11.095421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 89/173] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:10 2022] GET /identity/v3/projects/f868b361cbe341f981c4c6441e332398 => generated 298 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:11.104550 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10edec-330e-48d2-a43d-79c94a21a68a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:11.240784 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:11.298897 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3ab83fb-c514-46a7-8850-8cd228e732c8 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:11.309772 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b10edec-330e-48d2-a43d-79c94a21a68a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:11.367094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9d64ac41-1759-4555-bdd7-ccbbbcc555d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:11.367733 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64ac41-1759-4555-bdd7-ccbbbcc555d9 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:11.368014 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64ac41-1759-4555-bdd7-ccbbbcc555d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:11.368271 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9d64ac41-1759-4555-bdd7-ccbbbcc555d9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:11.369015 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64ac41-1759-4555-bdd7-ccbbbcc555d9 None admin] RBAC: Adding query filter params (role.id=c73e9539582145ed8eedc48648b9d738, scope.project.id=f868b361cbe341f981c4c6441e332398, user.id=bab4a9bddb7141a48bb694677f33efcc) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:11.369348 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64ac41-1759-4555-bdd7-ccbbbcc555d9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:11.371467 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9d64ac41-1759-4555-bdd7-ccbbbcc555d9 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:11.379065 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 90/174] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:11 2022] GET /identity/v3/role_assignments?user.id=bab4a9bddb7141a48bb694677f33efcc&scope.project.id=f868b361cbe341f981c4c6441e332398&role.id=c73e9539582145ed8eedc48648b9d738 => generated 608 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:11.405930 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d94ecf44-7270-4ae3-ba2e-b1b3b928f565 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:11.406606 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ecf44-7270-4ae3-ba2e-b1b3b928f565 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:11.406892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ecf44-7270-4ae3-ba2e-b1b3b928f565 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:11.407158 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d94ecf44-7270-4ae3-ba2e-b1b3b928f565 None admin] PATH_INFO: `/v3/projects/18a0a23ab1f24a28a2ea66573b4da46e` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:11.408565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ecf44-7270-4ae3-ba2e-b1b3b928f565 None admin] RBAC: Authorizing `identity:get_project(project_id=18a0a23ab1f24a28a2ea66573b4da46e)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:11.410334 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d94ecf44-7270-4ae3-ba2e-b1b3b928f565 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:11.411167 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48582be2-aeb3-4b8c-9e4d-41a059bee54e None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:11.411451 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48582be2-aeb3-4b8c-9e4d-41a059bee54e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:11.411720 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48582be2-aeb3-4b8c-9e4d-41a059bee54e None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:11.413100 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 91/176] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:51:11.413369 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 85/176] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:11 2022] GET /identity/v3/projects/18a0a23ab1f24a28a2ea66573b4da46e => generated 312 bytes in 386 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:11.418401 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48582be2-aeb3-4b8c-9e4d-41a059bee54e None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:11.423557 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc598ea-8dc5-40cb-88b7-60ea35303981 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:11.423840 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc598ea-8dc5-40cb-88b7-60ea35303981 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:11.424142 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cc598ea-8dc5-40cb-88b7-60ea35303981 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:11.462290 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-2cc598ea-8dc5-40cb-88b7-60ea35303981 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:11.463599 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2cc598ea-8dc5-40cb-88b7-60ea35303981 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:11.561566 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:11.651108 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 86/177] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:11 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:11.652195 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc598ea-8dc5-40cb-88b7-60ea35303981 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:11.654002 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48582be2-aeb3-4b8c-9e4d-41a059bee54e None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:11.718464 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:11.728281 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa1ad5-d616-4f36-9104-2e0667234a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:11.728909 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa1ad5-d616-4f36-9104-2e0667234a07 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:11.729309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa1ad5-d616-4f36-9104-2e0667234a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:11.730694 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18fa1ad5-d616-4f36-9104-2e0667234a07 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:11.731535 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa1ad5-d616-4f36-9104-2e0667234a07 None admin] RBAC: Adding query filter params (role.id=54545d831b9e469dad64f2d28c12e462, scope.project.id=18a0a23ab1f24a28a2ea66573b4da46e, user.id=5964ab09eab9453db0a9316d1da8e974) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:11.731844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa1ad5-d616-4f36-9104-2e0667234a07 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:11.733395 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18fa1ad5-d616-4f36-9104-2e0667234a07 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:11.740751 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 92/178] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:11 2022] GET /identity/v3/role_assignments?user.id=5964ab09eab9453db0a9316d1da8e974&scope.project.id=18a0a23ab1f24a28a2ea66573b4da46e&role.id=54545d831b9e469dad64f2d28c12e462 => generated 608 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:11.741853 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa1ad5-d616-4f36-9104-2e0667234a07 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:11.878065 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18fa1ad5-d616-4f36-9104-2e0667234a07 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:11.918916 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbac96-e2f5-4d0f-93bf-0e4e95adb992 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:11.919600 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbac96-e2f5-4d0f-93bf-0e4e95adb992 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:11.919878 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbac96-e2f5-4d0f-93bf-0e4e95adb992 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:11.920148 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60dbac96-e2f5-4d0f-93bf-0e4e95adb992 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:11.933332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60dbac96-e2f5-4d0f-93bf-0e4e95adb992 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:11.936402 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cc598ea-8dc5-40cb-88b7-60ea35303981 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:11.938874 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-60dbac96-e2f5-4d0f-93bf-0e4e95adb992 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:11.938874 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:11.938874 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:11.938874 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:11.938874 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:11.938874 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:11.938874 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:11.938874 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:11.938874 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:11.938874 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:11.938874 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:11.938874 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:11.938874 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:11.938874 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:11.938874 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:11.938874 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:11.942416 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:11.942416 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:11.942416 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:11.942416 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:11.942416 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:11.942416 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:11.942416 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:11.942416 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:11.942416 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:11.942416 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:11.942416 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:11.942416 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:11.942416 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:11.942416 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:11.942416 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:11.942416 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:11.945252 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:11.945252 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:11.945252 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:11.945252 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:11.945252 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:11.945252 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:11.945252 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:11.945252 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:11.945252 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:11.945252 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:11.945252 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:11.945252 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:11.945252 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 93/179] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 21 00:51:11 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 199 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:11.954484 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbac96-e2f5-4d0f-93bf-0e4e95adb992 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:12.049910 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09064c6d-ad08-45f7-9f45-1dc4b71b3e71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:12.050862 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09064c6d-ad08-45f7-9f45-1dc4b71b3e71 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:12.054728 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09064c6d-ad08-45f7-9f45-1dc4b71b3e71 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:12.055073 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09064c6d-ad08-45f7-9f45-1dc4b71b3e71 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:12.086649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:12.088431 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09064c6d-ad08-45f7-9f45-1dc4b71b3e71 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:12.098152 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-09064c6d-ad08-45f7-9f45-1dc4b71b3e71 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:12.098152 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:12.098152 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:12.098152 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:12.098152 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:12.098152 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:12.098152 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:12.098152 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:12.098152 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:12.098152 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:12.098152 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:12.098152 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:12.098152 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:12.098152 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:12.098152 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:12.098152 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:12.101759 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:12.101759 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:12.101759 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:12.101759 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:12.101759 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:12.101759 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:12.101759 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:12.101759 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:12.101759 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:12.101759 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:12.101759 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:12.101759 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:12.101759 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:12.101759 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:12.101759 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:12.101759 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:12.104649 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:12.104649 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:12.104649 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:12.104649 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:12.104649 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:12.104649 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:12.104649 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:12.104649 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:12.104649 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:12.104649 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:12.104649 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:12.104649 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:51:12.104649 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 87/180] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:11 2022] GET /identity/v3/roles/reader => generated 84 bytes in 448 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:12.116002 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09064c6d-ad08-45f7-9f45-1dc4b71b3e71 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:12.182366 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60dbac96-e2f5-4d0f-93bf-0e4e95adb992 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:12.195236 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:12.226590 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e787b9-09ad-4b4d-bff6-0df3bb159e0b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:12.227303 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e787b9-09ad-4b4d-bff6-0df3bb159e0b None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:12.227303 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e787b9-09ad-4b4d-bff6-0df3bb159e0b None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:12.227729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20e787b9-09ad-4b4d-bff6-0df3bb159e0b None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:12.232042 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e787b9-09ad-4b4d-bff6-0df3bb159e0b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:12.232042 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e787b9-09ad-4b4d-bff6-0df3bb159e0b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:12.232042 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20e787b9-09ad-4b4d-bff6-0df3bb159e0b None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:12.243166 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 94/181] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:51:11 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:12.244072 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e787b9-09ad-4b4d-bff6-0df3bb159e0b None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:12.370937 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09064c6d-ad08-45f7-9f45-1dc4b71b3e71 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:12.381119 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20e787b9-09ad-4b4d-bff6-0df3bb159e0b None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:12.407076 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:12.442147 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4f91c-7631-431c-8bf6-0b6920c857ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:12.443060 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4f91c-7631-431c-8bf6-0b6920c857ae None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:12.443216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8a5a715-4210-4b14-8fd1-90d7fb2fa50a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:12.443525 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4f91c-7631-431c-8bf6-0b6920c857ae None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:12.443870 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5a715-4210-4b14-8fd1-90d7fb2fa50a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:12.444021 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f5a4f91c-7631-431c-8bf6-0b6920c857ae None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:12.444290 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5a715-4210-4b14-8fd1-90d7fb2fa50a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:12.444439 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8a5a715-4210-4b14-8fd1-90d7fb2fa50a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:12.445210 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4f91c-7631-431c-8bf6-0b6920c857ae None admin] RBAC: Adding query filter params (name=reader) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:12.445732 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4f91c-7631-431c-8bf6-0b6920c857ae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:12.448425 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f5a4f91c-7631-431c-8bf6-0b6920c857ae None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:12.462447 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8a5a715-4210-4b14-8fd1-90d7fb2fa50a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:12.465481 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 88/182] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:12 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 350 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:12.467111 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4f91c-7631-431c-8bf6-0b6920c857ae None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:12.471981 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-d8a5a715-4210-4b14-8fd1-90d7fb2fa50a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:12.471981 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:12.471981 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:12.471981 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:12.471981 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:12.471981 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:12.471981 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:12.471981 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:12.471981 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:12.471981 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:12.471981 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:12.471981 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:12.471981 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:12.471981 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:12.471981 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:12.471981 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:12.473722 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:12.473722 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:12.473722 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:12.473722 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:12.473722 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:12.473722 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:12.473722 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:12.473722 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:12.473722 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:12.473722 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:12.473722 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:12.473722 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:12.473722 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:12.473722 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:12.473722 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:12.473722 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:12.475259 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:12.475259 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:12.475259 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:12.475259 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:12.475259 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:12.475259 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:12.475259 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:12.475259 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:12.475259 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:12.475259 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:12.475259 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:12.475259 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:12.475259 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 95/183] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:51:12 2022] GET /identity/v3/roles/admin => generated 83 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:12.476533 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6057f-5474-49cb-ab22-6aba470eea8c None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:12.476670 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6057f-5474-49cb-ab22-6aba470eea8c None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:12.477803 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e6057f-5474-49cb-ab22-6aba470eea8c None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:12.480068 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 96/184] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:12 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:12.481522 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6057f-5474-49cb-ab22-6aba470eea8c None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:12.590573 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:12.601343 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f5a4f91c-7631-431c-8bf6-0b6920c857ae None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:12.617686 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e6057f-5474-49cb-ab22-6aba470eea8c None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:12.638624 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62739b-84b8-4d7c-945a-3ad3b9da4c77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:12.639269 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62739b-84b8-4d7c-945a-3ad3b9da4c77 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:12.639544 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62739b-84b8-4d7c-945a-3ad3b9da4c77 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:12.639815 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d62739b-84b8-4d7c-945a-3ad3b9da4c77 None admin] PATH_INFO: `/v3/users/5964ab09eab9453db0a9316d1da8e974` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:12.641068 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62739b-84b8-4d7c-945a-3ad3b9da4c77 None admin] RBAC: Authorizing `identity:get_user(user_id=5964ab09eab9453db0a9316d1da8e974)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:12.642548 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d62739b-84b8-4d7c-945a-3ad3b9da4c77 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:12.644177 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 89/185] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:12 2022] GET /identity/v3/users/5964ab09eab9453db0a9316d1da8e974 => generated 275 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:12.644969 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62739b-84b8-4d7c-945a-3ad3b9da4c77 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:12.659283 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ddb92c1-45e7-4dc6-acf2-895d931d6436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:12.659921 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb92c1-45e7-4dc6-acf2-895d931d6436 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:12.660200 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb92c1-45e7-4dc6-acf2-895d931d6436 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:12.660472 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ddb92c1-45e7-4dc6-acf2-895d931d6436 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:12.661182 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb92c1-45e7-4dc6-acf2-895d931d6436 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:12.661487 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb92c1-45e7-4dc6-acf2-895d931d6436 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:12.662935 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ddb92c1-45e7-4dc6-acf2-895d931d6436 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:12.674813 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 97/186] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:12 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:12.680149 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508aaa7-4869-4e52-9ce0-aa5acb92f08f None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:12.680412 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508aaa7-4869-4e52-9ce0-aa5acb92f08f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:12.681007 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2508aaa7-4869-4e52-9ce0-aa5acb92f08f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:12.701508 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-2508aaa7-4869-4e52-9ce0-aa5acb92f08f None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:12.703067 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-2508aaa7-4869-4e52-9ce0-aa5acb92f08f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:12.737214 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:12.762022 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d62739b-84b8-4d7c-945a-3ad3b9da4c77 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:12.784695 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 98/187] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:12 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 109 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:12.786326 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734fc59-083c-4703-9c9d-a426aa36b239 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:12.786656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734fc59-083c-4703-9c9d-a426aa36b239 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:12.787078 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2734fc59-083c-4703-9c9d-a426aa36b239 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:12.788618 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 99/188] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:12.789950 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734fc59-083c-4703-9c9d-a426aa36b239 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:12.825925 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b88ec-1734-4794-ba1e-09e4f2d8462a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:12.826920 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b88ec-1734-4794-ba1e-09e4f2d8462a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:12.827506 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b88ec-1734-4794-ba1e-09e4f2d8462a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:12.827939 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-702b88ec-1734-4794-ba1e-09e4f2d8462a None admin] PATH_INFO: `/v3/users/55d6f2c056514d4e80e5fb74559dcdde` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:12.830897 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b88ec-1734-4794-ba1e-09e4f2d8462a None admin] RBAC: Authorizing `identity:get_user(user_id=55d6f2c056514d4e80e5fb74559dcdde)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:12.834342 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-702b88ec-1734-4794-ba1e-09e4f2d8462a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:12.837840 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 90/189] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:12 2022] GET /identity/v3/users/55d6f2c056514d4e80e5fb74559dcdde => generated 289 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:12.839735 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b88ec-1734-4794-ba1e-09e4f2d8462a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:12.894595 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:12.955534 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2734fc59-083c-4703-9c9d-a426aa36b239 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:12.996810 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6dd1bc-a5b7-4042-9c55-d2b8f264f678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:12.997575 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6dd1bc-a5b7-4042-9c55-d2b8f264f678 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:12.997850 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6dd1bc-a5b7-4042-9c55-d2b8f264f678 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:12.998124 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf6dd1bc-a5b7-4042-9c55-d2b8f264f678 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:13.004884 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-702b88ec-1734-4794-ba1e-09e4f2d8462a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:13.036314 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:13.062671 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94f3b76c-7142-40fb-a875-8da9f09bd009 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:13.063300 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3b76c-7142-40fb-a875-8da9f09bd009 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:13.063574 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3b76c-7142-40fb-a875-8da9f09bd009 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:13.063840 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94f3b76c-7142-40fb-a875-8da9f09bd009 None admin] PATH_INFO: `/v3/users/95d93f8e15b04d9e9eaa4401476755d5` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:13.079702 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f3b76c-7142-40fb-a875-8da9f09bd009 None admin] RBAC: Authorizing `identity:get_user(user_id=95d93f8e15b04d9e9eaa4401476755d5)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:13.081235 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94f3b76c-7142-40fb-a875-8da9f09bd009 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:13.083016 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 91/190] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:12 2022] GET /identity/v3/users/95d93f8e15b04d9e9eaa4401476755d5 => generated 283 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:13.087093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e1593-95cc-46ce-8539-8e1e2698ec32 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:13.087093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e1593-95cc-46ce-8539-8e1e2698ec32 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:13.087093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-043e1593-95cc-46ce-8539-8e1e2698ec32 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:13.102088 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6dd1bc-a5b7-4042-9c55-d2b8f264f678 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:13.103611 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf6dd1bc-a5b7-4042-9c55-d2b8f264f678 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:13.110214 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-043e1593-95cc-46ce-8539-8e1e2698ec32 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:13.112306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-043e1593-95cc-46ce-8539-8e1e2698ec32 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:13.208072 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 92/191] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:13 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:13.208846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e1593-95cc-46ce-8539-8e1e2698ec32 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:13.251019 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:13.271237 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 100/192] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:12 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 478 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:13.271237 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6dd1bc-a5b7-4042-9c55-d2b8f264f678 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:13.381026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:13.403760 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-043e1593-95cc-46ce-8539-8e1e2698ec32 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:13.445008 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf6dd1bc-a5b7-4042-9c55-d2b8f264f678 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:13.462392 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f7ff7-d480-4646-b7ca-60327b9d27c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:13.463238 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f7ff7-d480-4646-b7ca-60327b9d27c1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:13.463694 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f7ff7-d480-4646-b7ca-60327b9d27c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:13.464149 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f39f7ff7-d480-4646-b7ca-60327b9d27c1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:13.503808 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45a566-41ab-436c-8524-f62125bd243e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:13.504724 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45a566-41ab-436c-8524-f62125bd243e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:13.505290 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45a566-41ab-436c-8524-f62125bd243e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:13.505738 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c45a566-41ab-436c-8524-f62125bd243e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:13.571528 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f7ff7-d480-4646-b7ca-60327b9d27c1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:13.573079 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f39f7ff7-d480-4646-b7ca-60327b9d27c1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:13.594345 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:13.622323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45a566-41ab-436c-8524-f62125bd243e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:13.623919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c45a566-41ab-436c-8524-f62125bd243e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:13.704114 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:13.740042 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 93/193] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 531 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:13.741538 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f7ff7-d480-4646-b7ca-60327b9d27c1 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:13.758617 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 101/194] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 491 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:13.759603 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45a566-41ab-436c-8524-f62125bd243e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:13.884908 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f39f7ff7-d480-4646-b7ca-60327b9d27c1 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:13.910479 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c45a566-41ab-436c-8524-f62125bd243e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:13.912890 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:13.947136 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d208c6-af60-4b16-b83a-fe41f889eb9d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:13.948211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d208c6-af60-4b16-b83a-fe41f889eb9d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:13.948702 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d208c6-af60-4b16-b83a-fe41f889eb9d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:13.949310 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1d208c6-af60-4b16-b83a-fe41f889eb9d None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:13.951460 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d208c6-af60-4b16-b83a-fe41f889eb9d None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:13.954262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1d208c6-af60-4b16-b83a-fe41f889eb9d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:13.961210 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 94/195] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:51:13 2022] GET /identity/v3/domains/default => generated 199 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:13.961210 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d208c6-af60-4b16-b83a-fe41f889eb9d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:13.961614 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16c078-a9d4-4f81-aa4a-8d160b2bd43b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:13.962247 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16c078-a9d4-4f81-aa4a-8d160b2bd43b None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:13.962722 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16c078-a9d4-4f81-aa4a-8d160b2bd43b None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:13.963214 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e16c078-a9d4-4f81-aa4a-8d160b2bd43b None admin] PATH_INFO: `/v3/projects/f868b361cbe341f981c4c6441e332398` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:13.965943 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16c078-a9d4-4f81-aa4a-8d160b2bd43b None admin] RBAC: Authorizing `identity:get_project(project_id=f868b361cbe341f981c4c6441e332398)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:13.968390 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e16c078-a9d4-4f81-aa4a-8d160b2bd43b None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:13.970552 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 102/196] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:13 2022] GET /identity/v3/projects/f868b361cbe341f981c4c6441e332398 => generated 298 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:13.971898 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16c078-a9d4-4f81-aa4a-8d160b2bd43b None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:14.011774 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:14.088125 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e16c078-a9d4-4f81-aa4a-8d160b2bd43b None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:14.127587 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1d208c6-af60-4b16-b83a-fe41f889eb9d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:14.149099 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a34352-16b3-4ac0-8f90-0723ff148e5b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:14.149885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a34352-16b3-4ac0-8f90-0723ff148e5b None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:14.150027 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a34352-16b3-4ac0-8f90-0723ff148e5b None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:14.150263 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34a34352-16b3-4ac0-8f90-0723ff148e5b None admin] PATH_INFO: `/v3/projects/f868b361cbe341f981c4c6441e332398` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:14.151427 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a34352-16b3-4ac0-8f90-0723ff148e5b None admin] RBAC: Authorizing `identity:get_project(project_id=f868b361cbe341f981c4c6441e332398)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:14.152922 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34a34352-16b3-4ac0-8f90-0723ff148e5b None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:14.154652 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 103/197] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:13 2022] GET /identity/v3/projects/f868b361cbe341f981c4c6441e332398 => generated 298 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:14.155449 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a34352-16b3-4ac0-8f90-0723ff148e5b None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:14.164938 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70232a4a-e4ec-4996-a9c4-332a4a11609a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:14.165723 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70232a4a-e4ec-4996-a9c4-332a4a11609a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:14.165995 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70232a4a-e4ec-4996-a9c4-332a4a11609a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:14.166265 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70232a4a-e4ec-4996-a9c4-332a4a11609a None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:14.178074 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70232a4a-e4ec-4996-a9c4-332a4a11609a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:14.184408 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-70232a4a-e4ec-4996-a9c4-332a4a11609a None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:14.184408 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:14.184408 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:14.184408 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:14.184408 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:14.184408 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:14.184408 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:14.184408 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:14.184408 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:14.184408 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:14.184408 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:14.184408 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:14.184408 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:14.184408 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:14.184408 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:14.184408 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:14.185626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:14.185626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:14.185626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:14.185626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:14.185626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:14.185626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:14.185626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:14.185626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:14.185626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:14.185626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:14.185626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:14.185626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:14.185626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:14.185626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:14.185626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:14.185626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:14.186448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:14.186448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:14.186448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:14.186448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:14.186448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:14.186448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:14.186448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:14.186448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:14.186448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:14.186448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:14.186448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:14.186448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:51:14.187068 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 95/198] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 21 00:51:13 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:14.187825 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70232a4a-e4ec-4996-a9c4-332a4a11609a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:14.258352 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:14.303534 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34a34352-16b3-4ac0-8f90-0723ff148e5b None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:14.307937 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:14.340687 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70232a4a-e4ec-4996-a9c4-332a4a11609a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:14.368176 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdc940-9ecc-43af-9fe7-e6e1be4b1b13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:14.369242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdc940-9ecc-43af-9fe7-e6e1be4b1b13 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:14.369529 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdc940-9ecc-43af-9fe7-e6e1be4b1b13 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:14.369817 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33fdc940-9ecc-43af-9fe7-e6e1be4b1b13 None admin] PATH_INFO: `/v3/projects/796ee44386c443e8885ece664a23534b` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:14.371609 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fdc940-9ecc-43af-9fe7-e6e1be4b1b13 None admin] RBAC: Authorizing `identity:get_project(project_id=796ee44386c443e8885ece664a23534b)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:14.373180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33fdc940-9ecc-43af-9fe7-e6e1be4b1b13 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:14.375501 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 104/199] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:14 2022] GET /identity/v3/projects/796ee44386c443e8885ece664a23534b => generated 302 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:14.376917 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdc940-9ecc-43af-9fe7-e6e1be4b1b13 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:14.396414 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ac480-036a-4a39-925f-f4ea2152ed1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:14.397449 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ac480-036a-4a39-925f-f4ea2152ed1e None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:14.397904 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ac480-036a-4a39-925f-f4ea2152ed1e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:14.398342 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-498ac480-036a-4a39-925f-f4ea2152ed1e None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:14.399465 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ac480-036a-4a39-925f-f4ea2152ed1e None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:14.402076 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-498ac480-036a-4a39-925f-f4ea2152ed1e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:14.437515 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 96/200] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 21 00:51:14 2022] POST /identity/v3/users => generated 297 bytes in 250 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:51:14.438446 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ac480-036a-4a39-925f-f4ea2152ed1e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:14.572809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33fdc940-9ecc-43af-9fe7-e6e1be4b1b13 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:14.585647 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:14.591506 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-498ac480-036a-4a39-925f-f4ea2152ed1e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:14.640011 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188d584-2c6f-41bb-b460-e028ac041eec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:14.641092 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188d584-2c6f-41bb-b460-e028ac041eec None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:14.641570 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188d584-2c6f-41bb-b460-e028ac041eec None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:14.642419 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4188d584-2c6f-41bb-b460-e028ac041eec None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:14.643325 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188d584-2c6f-41bb-b460-e028ac041eec None admin] RBAC: Adding query filter params (role.id=f186b24dc4eb43668f180c85b7c1fc20, scope.project.id=f868b361cbe341f981c4c6441e332398, user.id=5964ab09eab9453db0a9316d1da8e974) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:14.643873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188d584-2c6f-41bb-b460-e028ac041eec None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:14.648159 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94112553-2f6a-400e-8141-e477ec34cbc5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:14.648322 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4188d584-2c6f-41bb-b460-e028ac041eec None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:14.648429 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94112553-2f6a-400e-8141-e477ec34cbc5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:14.648429 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94112553-2f6a-400e-8141-e477ec34cbc5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:14.648429 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94112553-2f6a-400e-8141-e477ec34cbc5 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:14.649405 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94112553-2f6a-400e-8141-e477ec34cbc5 None admin] RBAC: Adding query filter params (role.id=3ad6ad0ef7dd4a94be313f7b1074a82e, scope.project.id=f868b361cbe341f981c4c6441e332398, user.id=55d6f2c056514d4e80e5fb74559dcdde) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:14.649526 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94112553-2f6a-400e-8141-e477ec34cbc5 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:14.651181 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94112553-2f6a-400e-8141-e477ec34cbc5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:14.655633 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 105/201] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:14 2022] GET /identity/v3/role_assignments?user.id=5964ab09eab9453db0a9316d1da8e974&scope.project.id=f868b361cbe341f981c4c6441e332398&role.id=f186b24dc4eb43668f180c85b7c1fc20 => generated 608 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:14.656827 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188d584-2c6f-41bb-b460-e028ac041eec None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:14.658331 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 97/202] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:14 2022] GET /identity/v3/role_assignments?user.id=55d6f2c056514d4e80e5fb74559dcdde&scope.project.id=f868b361cbe341f981c4c6441e332398&role.id=3ad6ad0ef7dd4a94be313f7b1074a82e => generated 608 bytes in 220 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:14.670465 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94112553-2f6a-400e-8141-e477ec34cbc5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:14.710897 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:14.836057 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4188d584-2c6f-41bb-b460-e028ac041eec None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:14.891975 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94112553-2f6a-400e-8141-e477ec34cbc5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:14.909364 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77a1c6-6a43-4934-808c-f2ea22568c82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:14.910472 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77a1c6-6a43-4934-808c-f2ea22568c82 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:14.910948 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77a1c6-6a43-4934-808c-f2ea22568c82 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:14.911409 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0f77a1c6-6a43-4934-808c-f2ea22568c82 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:14.912651 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77a1c6-6a43-4934-808c-f2ea22568c82 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:14.913862 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77a1c6-6a43-4934-808c-f2ea22568c82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:14.915543 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0f77a1c6-6a43-4934-808c-f2ea22568c82 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:14.927940 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 106/203] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:51:14 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:14.937827 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77a1c6-6a43-4934-808c-f2ea22568c82 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:14.966808 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9af4b-667d-4b58-92d6-432867af22d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:14.967460 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9af4b-667d-4b58-92d6-432867af22d3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:14.967739 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9af4b-667d-4b58-92d6-432867af22d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:14.968015 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd9af4b-667d-4b58-92d6-432867af22d3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:14.968793 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9af4b-667d-4b58-92d6-432867af22d3 None admin] RBAC: Adding query filter params (role.id=c73e9539582145ed8eedc48648b9d738, scope.project.id=796ee44386c443e8885ece664a23534b, user.id=95d93f8e15b04d9e9eaa4401476755d5) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:14.969253 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9af4b-667d-4b58-92d6-432867af22d3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:14.970859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd9af4b-667d-4b58-92d6-432867af22d3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:14.981970 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 98/204] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:14 2022] GET /identity/v3/role_assignments?user.id=95d93f8e15b04d9e9eaa4401476755d5&scope.project.id=796ee44386c443e8885ece664a23534b&role.id=c73e9539582145ed8eedc48648b9d738 => generated 259 bytes in 312 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:15.107471 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:15.116102 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0f77a1c6-6a43-4934-808c-f2ea22568c82 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:15.180206 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c66fc5-f6c3-40ca-a6a8-5d1850cdfce8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:15.181349 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c66fc5-f6c3-40ca-a6a8-5d1850cdfce8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:15.181823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c66fc5-f6c3-40ca-a6a8-5d1850cdfce8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:15.182270 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9c66fc5-f6c3-40ca-a6a8-5d1850cdfce8 None admin] PATH_INFO: `/v3/users/95d93f8e15b04d9e9eaa4401476755d5` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:15.184327 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c66fc5-f6c3-40ca-a6a8-5d1850cdfce8 None admin] RBAC: Authorizing `identity:get_user(user_id=95d93f8e15b04d9e9eaa4401476755d5)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:15.187232 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9c66fc5-f6c3-40ca-a6a8-5d1850cdfce8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:15.190762 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 107/205] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:14 2022] GET /identity/v3/users/95d93f8e15b04d9e9eaa4401476755d5 => generated 283 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:15.198307 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9af4b-667d-4b58-92d6-432867af22d3 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:15.244790 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:15.348515 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd9af4b-667d-4b58-92d6-432867af22d3 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:15.389757 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f95f0e-f49b-4c2f-a2f0-56647758f251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:15.390289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f95f0e-f49b-4c2f-a2f0-56647758f251 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:15.390596 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f95f0e-f49b-4c2f-a2f0-56647758f251 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:15.390864 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65f95f0e-f49b-4c2f-a2f0-56647758f251 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:15.473593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f95f0e-f49b-4c2f-a2f0-56647758f251 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:15.475134 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65f95f0e-f49b-4c2f-a2f0-56647758f251 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:15.520170 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:15.661478 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 99/206] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:15 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:15.670212 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c66fc5-f6c3-40ca-a6a8-5d1850cdfce8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:15.823450 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9c66fc5-f6c3-40ca-a6a8-5d1850cdfce8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:15.862041 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27b8aee9-3e65-49e6-9ac4-2c2038ce43d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:15.862699 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8aee9-3e65-49e6-9ac4-2c2038ce43d2 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:15.862974 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8aee9-3e65-49e6-9ac4-2c2038ce43d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:15.863242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27b8aee9-3e65-49e6-9ac4-2c2038ce43d2 None admin] PATH_INFO: `/v3/projects/796ee44386c443e8885ece664a23534b` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:15.864436 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8aee9-3e65-49e6-9ac4-2c2038ce43d2 None admin] RBAC: Authorizing `identity:get_project(project_id=796ee44386c443e8885ece664a23534b)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:15.866023 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27b8aee9-3e65-49e6-9ac4-2c2038ce43d2 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:15.867753 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 108/207] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:15 2022] GET /identity/v3/projects/796ee44386c443e8885ece664a23534b => generated 302 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:15.877699 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f95f0e-f49b-4c2f-a2f0-56647758f251 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:16.032284 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65f95f0e-f49b-4c2f-a2f0-56647758f251 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:16.063438 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:16.071775 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04b4b341-6f71-4714-9e6d-882cce155321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:16.072405 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4b341-6f71-4714-9e6d-882cce155321 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:16.073859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4b341-6f71-4714-9e6d-882cce155321 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:16.073859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04b4b341-6f71-4714-9e6d-882cce155321 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:16.073859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4b341-6f71-4714-9e6d-882cce155321 None admin] RBAC: Adding query filter params (role.id=f186b24dc4eb43668f180c85b7c1fc20, scope.project.id=796ee44386c443e8885ece664a23534b, user.id=95d93f8e15b04d9e9eaa4401476755d5) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:16.074231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4b341-6f71-4714-9e6d-882cce155321 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:16.075547 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04b4b341-6f71-4714-9e6d-882cce155321 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:16.082379 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 100/208] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:15 2022] GET /identity/v3/role_assignments?user.id=95d93f8e15b04d9e9eaa4401476755d5&scope.project.id=796ee44386c443e8885ece664a23534b&role.id=f186b24dc4eb43668f180c85b7c1fc20 => generated 259 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:17.358540 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73beea6-8753-4ae1-b543-47487c31b601 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:17.359618 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73beea6-8753-4ae1-b543-47487c31b601 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:17.360102 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d73beea6-8753-4ae1-b543-47487c31b601 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:17.361861 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 109/209] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:17.368299 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cfab9-1d71-42ec-aa9d-6dfca3a53283 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:17.369354 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cfab9-1d71-42ec-aa9d-6dfca3a53283 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:17.369830 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-225cfab9-1d71-42ec-aa9d-6dfca3a53283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:17.391882 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-225cfab9-1d71-42ec-aa9d-6dfca3a53283 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:17.393506 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-225cfab9-1d71-42ec-aa9d-6dfca3a53283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:17.490094 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 101/210] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:17.576939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f376da-a102-4d17-bd3b-ccd45a8c9ef0 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:17.577966 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f376da-a102-4d17-bd3b-ccd45a8c9ef0 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:17.578735 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f376da-a102-4d17-bd3b-ccd45a8c9ef0 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:17.581617 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 110/211] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:17.590370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44744ca-d26d-4659-94ce-7d2b77b616d3 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:17.590836 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44744ca-d26d-4659-94ce-7d2b77b616d3 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:17.590989 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44744ca-d26d-4659-94ce-7d2b77b616d3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:17.610724 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-d44744ca-d26d-4659-94ce-7d2b77b616d3 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:17.612248 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d44744ca-d26d-4659-94ce-7d2b77b616d3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:17.634350 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4e501-5e89-4a8d-bd13-c4d9bcc2648f None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:17.635283 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4e501-5e89-4a8d-bd13-c4d9bcc2648f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:17.636038 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e5f4e501-5e89-4a8d-bd13-c4d9bcc2648f None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:17.638971 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 111/212] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:17 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:17.648149 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0440cf-c500-4205-a25b-35adb46a4e24 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:17.649069 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0440cf-c500-4205-a25b-35adb46a4e24 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:17.649816 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce0440cf-c500-4205-a25b-35adb46a4e24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:17.682149 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-ce0440cf-c500-4205-a25b-35adb46a4e24 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:17.684871 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-ce0440cf-c500-4205-a25b-35adb46a4e24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:17.688293 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 102/213] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 99 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:17.728385 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:17.776493 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 112/214] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:17 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:17.802324 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44744ca-d26d-4659-94ce-7d2b77b616d3 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:17.881786 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:17.940176 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44744ca-d26d-4659-94ce-7d2b77b616d3 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:17.978329 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11af34b-62d3-40c7-b8a6-8caa23ace678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:17.978970 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11af34b-62d3-40c7-b8a6-8caa23ace678 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:17.979258 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11af34b-62d3-40c7-b8a6-8caa23ace678 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:17.979502 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c11af34b-62d3-40c7-b8a6-8caa23ace678 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:17.991277 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c11af34b-62d3-40c7-b8a6-8caa23ace678 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:17.995959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0440cf-c500-4205-a25b-35adb46a4e24 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:17.996166 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-c11af34b-62d3-40c7-b8a6-8caa23ace678 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:17.996166 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:17.996166 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:17.996166 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:17.996166 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:17.996166 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:17.996166 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:17.996166 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:17.996166 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:17.996166 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:17.996166 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:17.996166 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:17.996166 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:17.996166 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:17.996166 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:17.996166 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:17.997868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:17.997868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:17.997868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:17.997868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:17.997868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:17.997868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:17.997868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:17.997868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:17.997868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:17.997868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:17.997868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:17.997868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:17.997868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:17.997868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:17.997868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:17.997868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:17.999467 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:17.999467 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:17.999467 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:17.999467 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:17.999467 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:17.999467 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:17.999467 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:17.999467 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:17.999467 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:17.999467 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:17.999467 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:17.999467 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:51:17.999467 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 103/215] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:51:17 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:18.003575 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11af34b-62d3-40c7-b8a6-8caa23ace678 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:18.133365 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c11af34b-62d3-40c7-b8a6-8caa23ace678 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:18.158741 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:18.165578 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce0440cf-c500-4205-a25b-35adb46a4e24 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:18.183853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca09c73-a1bc-40b7-95a4-87eecce386b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:18.184476 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca09c73-a1bc-40b7-95a4-87eecce386b5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:18.184896 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca09c73-a1bc-40b7-95a4-87eecce386b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:18.185141 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ca09c73-a1bc-40b7-95a4-87eecce386b5 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:18.185971 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca09c73-a1bc-40b7-95a4-87eecce386b5 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:18.186542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca09c73-a1bc-40b7-95a4-87eecce386b5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:18.187991 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ca09c73-a1bc-40b7-95a4-87eecce386b5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:18.198530 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 104/216] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:18 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:18.204573 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca09c73-a1bc-40b7-95a4-87eecce386b5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:18.220349 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e7b99-25f3-495d-8326-f26316fe5197 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:18.221522 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e7b99-25f3-495d-8326-f26316fe5197 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:18.221997 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e7b99-25f3-495d-8326-f26316fe5197 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:18.222529 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f13e7b99-25f3-495d-8326-f26316fe5197 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:18.247305 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f13e7b99-25f3-495d-8326-f26316fe5197 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:18.257224 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-f13e7b99-25f3-495d-8326-f26316fe5197 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:18.257224 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:18.257224 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:18.257224 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:18.257224 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:18.257224 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:18.257224 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:18.257224 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:18.257224 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:18.257224 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:18.257224 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:18.257224 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:18.257224 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:18.257224 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:18.257224 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:18.257224 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:18.259242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:18.259242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:18.259242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:18.259242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:18.259242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:18.259242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:18.259242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:18.259242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:18.259242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:18.259242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:18.259242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:18.259242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:18.259242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:18.259242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:18.259242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:18.259242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:18.260721 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:18.260721 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:18.260721 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:18.260721 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:18.260721 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:18.260721 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:18.260721 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:18.260721 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:18.260721 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:18.260721 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:18.260721 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:18.260721 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:18.269253 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 113/217] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:17 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:18.275447 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e7b99-25f3-495d-8326-f26316fe5197 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:18.319544 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:18.333353 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ca09c73-a1bc-40b7-95a4-87eecce386b5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:18.397836 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ca9fd-8598-4c9f-af06-f9921274cfc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:18.399154 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ca9fd-8598-4c9f-af06-f9921274cfc1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:18.399644 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ca9fd-8598-4c9f-af06-f9921274cfc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:18.400138 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b22ca9fd-8598-4c9f-af06-f9921274cfc1 None admin] PATH_INFO: `/v3/users/95d93f8e15b04d9e9eaa4401476755d5` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:18.402272 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ca9fd-8598-4c9f-af06-f9921274cfc1 None admin] RBAC: Authorizing `identity:get_user(user_id=95d93f8e15b04d9e9eaa4401476755d5)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:18.405036 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b22ca9fd-8598-4c9f-af06-f9921274cfc1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:18.412784 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 105/218] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:18 2022] GET /identity/v3/users/95d93f8e15b04d9e9eaa4401476755d5 => generated 283 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:18.412784 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ca9fd-8598-4c9f-af06-f9921274cfc1 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:18.435925 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f13e7b99-25f3-495d-8326-f26316fe5197 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:18.479661 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:18.503954 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d854f-1f22-4ce5-a90c-e4fce36e8e8d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:18.504973 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d854f-1f22-4ce5-a90c-e4fce36e8e8d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:18.505480 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d854f-1f22-4ce5-a90c-e4fce36e8e8d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:18.505936 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c0d854f-1f22-4ce5-a90c-e4fce36e8e8d None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:18.507150 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d854f-1f22-4ce5-a90c-e4fce36e8e8d None admin] RBAC: Adding query filter params (name=member) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:18.507663 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d854f-1f22-4ce5-a90c-e4fce36e8e8d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:18.510203 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2c0d854f-1f22-4ce5-a90c-e4fce36e8e8d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:18.533170 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 114/219] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:18 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:18.533170 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d854f-1f22-4ce5-a90c-e4fce36e8e8d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:18.553006 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b22ca9fd-8598-4c9f-af06-f9921274cfc1 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:18.594847 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a24da3-626c-46ae-8043-e233ee7cf7d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:18.595491 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a24da3-626c-46ae-8043-e233ee7cf7d2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:18.595763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a24da3-626c-46ae-8043-e233ee7cf7d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:18.596030 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7a24da3-626c-46ae-8043-e233ee7cf7d2 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:18.597340 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a24da3-626c-46ae-8043-e233ee7cf7d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:18.598981 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7a24da3-626c-46ae-8043-e233ee7cf7d2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:18.600954 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 106/220] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:51:18 2022] GET /identity/v3/domains/default => generated 199 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:18.601631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a24da3-626c-46ae-8043-e233ee7cf7d2 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:18.699119 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:18.731675 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c0d854f-1f22-4ce5-a90c-e4fce36e8e8d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:18.758711 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7a24da3-626c-46ae-8043-e233ee7cf7d2 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:18.773193 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:18.794543 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c5dcd-eae4-41c2-ba5c-9cfb24f5572c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:18.795614 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c5dcd-eae4-41c2-ba5c-9cfb24f5572c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:18.796077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c5dcd-eae4-41c2-ba5c-9cfb24f5572c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:18.796529 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c78c5dcd-eae4-41c2-ba5c-9cfb24f5572c None admin] PATH_INFO: `/v3/projects/796ee44386c443e8885ece664a23534b` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:18.798607 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c5dcd-eae4-41c2-ba5c-9cfb24f5572c None admin] RBAC: Authorizing `identity:get_project(project_id=796ee44386c443e8885ece664a23534b)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:18.801724 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c78c5dcd-eae4-41c2-ba5c-9cfb24f5572c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:18.802672 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad587aea-ebbd-44bb-a045-6ceff995ec58 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:18.803344 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad587aea-ebbd-44bb-a045-6ceff995ec58 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:18.803614 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad587aea-ebbd-44bb-a045-6ceff995ec58 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:18.803878 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad587aea-ebbd-44bb-a045-6ceff995ec58 None admin] PATH_INFO: `/v3/users/216a826ed0544041b19d313c7d9b4ce7` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:18.812890 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 115/221] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:18 2022] GET /identity/v3/projects/796ee44386c443e8885ece664a23534b => generated 302 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:18.812890 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c5dcd-eae4-41c2-ba5c-9cfb24f5572c None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:18.837504 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad587aea-ebbd-44bb-a045-6ceff995ec58 None admin] RBAC: Authorizing `identity:get_user(user_id=216a826ed0544041b19d313c7d9b4ce7)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:18.840614 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad587aea-ebbd-44bb-a045-6ceff995ec58 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:18.851345 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 107/222] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:18 2022] GET /identity/v3/users/216a826ed0544041b19d313c7d9b4ce7 => generated 297 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:18.852545 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad587aea-ebbd-44bb-a045-6ceff995ec58 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:18.986025 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c78c5dcd-eae4-41c2-ba5c-9cfb24f5572c None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:19.024548 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23f246-a27b-45a9-9d5b-71c7fae924d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:19.025367 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23f246-a27b-45a9-9d5b-71c7fae924d6 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:19.025736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23f246-a27b-45a9-9d5b-71c7fae924d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:19.026150 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23f246-a27b-45a9-9d5b-71c7fae924d6 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:19.026831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad587aea-ebbd-44bb-a045-6ceff995ec58 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:19.027108 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23f246-a27b-45a9-9d5b-71c7fae924d6 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:19.028753 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23f246-a27b-45a9-9d5b-71c7fae924d6 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:19.060005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 116/223] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 21 00:51:18 2022] POST /identity/v3/users => generated 297 bytes in 254 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:51:19.072082 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23f246-a27b-45a9-9d5b-71c7fae924d6 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:19.092259 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1e550d-9633-47ae-a995-c4df31d8973f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:19.092989 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e550d-9633-47ae-a995-c4df31d8973f None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:19.093310 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e550d-9633-47ae-a995-c4df31d8973f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:19.093562 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1e550d-9633-47ae-a995-c4df31d8973f None admin] PATH_INFO: `/v3/projects/796ee44386c443e8885ece664a23534b/users/95d93f8e15b04d9e9eaa4401476755d5/roles/c73e9539582145ed8eedc48648b9d738` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:19.095563 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:19.095762 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e550d-9633-47ae-a995-c4df31d8973f None admin] RBAC: Authorizing `identity:create_grant(project_id=796ee44386c443e8885ece664a23534b, user_id=95d93f8e15b04d9e9eaa4401476755d5, role_id=c73e9539582145ed8eedc48648b9d738)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:19.097354 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1e550d-9633-47ae-a995-c4df31d8973f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:19.119259 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 108/224] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 21 00:51:18 2022] PUT /identity/v3/projects/796ee44386c443e8885ece664a23534b/users/95d93f8e15b04d9e9eaa4401476755d5/roles/c73e9539582145ed8eedc48648b9d738 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:19.125305 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03582a75-23b8-42ce-b414-75dc6ce7b038 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:19.125305 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03582a75-23b8-42ce-b414-75dc6ce7b038 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:19.125305 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-03582a75-23b8-42ce-b414-75dc6ce7b038 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:19.125305 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 109/225] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:19.133763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686a26f-d033-4357-8791-e758e328a525 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:19.134218 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686a26f-d033-4357-8791-e758e328a525 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:19.134651 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b686a26f-d033-4357-8791-e758e328a525 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:19.164074 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-b686a26f-d033-4357-8791-e758e328a525 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:19.166121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b686a26f-d033-4357-8791-e758e328a525 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:19.209348 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:19.259394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23f246-a27b-45a9-9d5b-71c7fae924d6 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:19.308644 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 110/226] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:19.315007 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721b0e6-9d93-4dc6-bb9f-4cd32577c597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:19.315654 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721b0e6-9d93-4dc6-bb9f-4cd32577c597 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:19.315923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721b0e6-9d93-4dc6-bb9f-4cd32577c597 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:19.316195 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8721b0e6-9d93-4dc6-bb9f-4cd32577c597 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:19.415001 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721b0e6-9d93-4dc6-bb9f-4cd32577c597 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:19.416502 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8721b0e6-9d93-4dc6-bb9f-4cd32577c597 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:19.429123 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:19.566097 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 117/227] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:19.574378 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686a26f-d033-4357-8791-e758e328a525 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:19.624277 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721b0e6-9d93-4dc6-bb9f-4cd32577c597 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:19.704186 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b686a26f-d033-4357-8791-e758e328a525 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:19.747083 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1311e29-0ef5-4c4f-85eb-d3a5138d28b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:19.747888 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1311e29-0ef5-4c4f-85eb-d3a5138d28b5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:19.748174 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1311e29-0ef5-4c4f-85eb-d3a5138d28b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:19.748445 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1311e29-0ef5-4c4f-85eb-d3a5138d28b5 None admin] PATH_INFO: `/v3/projects/796ee44386c443e8885ece664a23534b` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:19.749865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1311e29-0ef5-4c4f-85eb-d3a5138d28b5 None admin] RBAC: Authorizing `identity:get_project(project_id=796ee44386c443e8885ece664a23534b)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:19.751800 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1311e29-0ef5-4c4f-85eb-d3a5138d28b5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:19.753771 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 111/228] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:19 2022] GET /identity/v3/projects/796ee44386c443e8885ece664a23534b => generated 302 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:19.760367 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1311e29-0ef5-4c4f-85eb-d3a5138d28b5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:19.821897 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8721b0e6-9d93-4dc6-bb9f-4cd32577c597 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:19.825702 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:19.837444 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:19.872700 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32434857-7ddc-41cc-ac45-3861eb5352e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:19.873409 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32434857-7ddc-41cc-ac45-3861eb5352e9 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:19.873686 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32434857-7ddc-41cc-ac45-3861eb5352e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:19.873955 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32434857-7ddc-41cc-ac45-3861eb5352e9 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:19.889508 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32434857-7ddc-41cc-ac45-3861eb5352e9 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:19.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-32434857-7ddc-41cc-ac45-3861eb5352e9 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:19.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:19.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:19.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:19.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:19.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:19.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:19.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:19.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:19.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:19.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:19.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:19.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:19.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:19.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:19.901102 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:19.902901 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:19.902901 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:19.902901 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:19.902901 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:19.902901 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:19.902901 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:19.902901 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:19.902901 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:19.902901 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:19.902901 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:19.902901 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:19.902901 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:19.902901 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:19.902901 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:19.902901 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:19.902901 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:19.904476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:19.904476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:19.904476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:19.904476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:19.904476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:19.904476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:19.904476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:19.904476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:19.904476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:19.904476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:19.904476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:19.904476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:19.904476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 118/229] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 21 00:51:19 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 274 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:51:19.918445 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32434857-7ddc-41cc-ac45-3861eb5352e9 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:20.018731 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1311e29-0ef5-4c4f-85eb-d3a5138d28b5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:20.049001 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32434857-7ddc-41cc-ac45-3861eb5352e9 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:20.095502 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce990b5-ef3a-4458-aeb5-d380ff388959 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:20.096031 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce990b5-ef3a-4458-aeb5-d380ff388959 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:20.096307 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce990b5-ef3a-4458-aeb5-d380ff388959 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:20.096572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ce990b5-ef3a-4458-aeb5-d380ff388959 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:20.097277 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce990b5-ef3a-4458-aeb5-d380ff388959 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:20.097579 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce990b5-ef3a-4458-aeb5-d380ff388959 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:20.099035 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ce990b5-ef3a-4458-aeb5-d380ff388959 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:20.117334 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 119/230] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:51:19 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:20.121672 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11c404-ebf2-48e3-a2c0-ed1ce477b59b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:20.122298 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11c404-ebf2-48e3-a2c0-ed1ce477b59b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:20.122565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11c404-ebf2-48e3-a2c0-ed1ce477b59b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:20.122823 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa11c404-ebf2-48e3-a2c0-ed1ce477b59b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:20.123583 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11c404-ebf2-48e3-a2c0-ed1ce477b59b None admin] RBAC: Adding query filter params (role.id=54545d831b9e469dad64f2d28c12e462, scope.project.id=796ee44386c443e8885ece664a23534b, user.id=216a826ed0544041b19d313c7d9b4ce7) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:20.123889 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11c404-ebf2-48e3-a2c0-ed1ce477b59b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:20.125408 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aa11c404-ebf2-48e3-a2c0-ed1ce477b59b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:20.129399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce990b5-ef3a-4458-aeb5-d380ff388959 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:20.146621 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 112/231] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:19 2022] GET /identity/v3/role_assignments?user.id=216a826ed0544041b19d313c7d9b4ce7&scope.project.id=796ee44386c443e8885ece664a23534b&role.id=54545d831b9e469dad64f2d28c12e462 => generated 259 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:20.174681 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:20.256327 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ce990b5-ef3a-4458-aeb5-d380ff388959 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:20.297247 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f9502-22b1-4e53-9f79-66dc45606530 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:20.297935 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f9502-22b1-4e53-9f79-66dc45606530 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:20.298213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f9502-22b1-4e53-9f79-66dc45606530 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:20.298482 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e5f9502-22b1-4e53-9f79-66dc45606530 None admin] PATH_INFO: `/v3/users/95d93f8e15b04d9e9eaa4401476755d5` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:20.299859 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f9502-22b1-4e53-9f79-66dc45606530 None admin] RBAC: Authorizing `identity:get_user(user_id=95d93f8e15b04d9e9eaa4401476755d5)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:20.301431 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e5f9502-22b1-4e53-9f79-66dc45606530 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:20.303529 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 120/232] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:20 2022] GET /identity/v3/users/95d93f8e15b04d9e9eaa4401476755d5 => generated 283 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:20.314326 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11c404-ebf2-48e3-a2c0-ed1ce477b59b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:20.486577 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:20.505069 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa11c404-ebf2-48e3-a2c0-ed1ce477b59b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:20.588859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d98612d-c104-4a57-90a9-bdbdc8c3269b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:20.590197 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98612d-c104-4a57-90a9-bdbdc8c3269b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:20.590773 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98612d-c104-4a57-90a9-bdbdc8c3269b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:20.591243 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d98612d-c104-4a57-90a9-bdbdc8c3269b None admin] PATH_INFO: `/v3/projects/796ee44386c443e8885ece664a23534b` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:20.594322 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98612d-c104-4a57-90a9-bdbdc8c3269b None admin] RBAC: Authorizing `identity:get_project(project_id=796ee44386c443e8885ece664a23534b)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:20.597133 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d98612d-c104-4a57-90a9-bdbdc8c3269b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:20.600628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 113/233] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:20 2022] GET /identity/v3/projects/796ee44386c443e8885ece664a23534b => generated 302 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:20.610006 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f9502-22b1-4e53-9f79-66dc45606530 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:20.757031 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:20.766436 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e5f9502-22b1-4e53-9f79-66dc45606530 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:20.812715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1c200679-b4ff-4ca1-84b2-18fce24e3358 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:20.813442 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c200679-b4ff-4ca1-84b2-18fce24e3358 None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:20.813719 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c200679-b4ff-4ca1-84b2-18fce24e3358 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:20.813983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1c200679-b4ff-4ca1-84b2-18fce24e3358 None admin] PATH_INFO: `/v3/projects/796ee44386c443e8885ece664a23534b/users/95d93f8e15b04d9e9eaa4401476755d5/roles/f186b24dc4eb43668f180c85b7c1fc20` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:20.816336 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c200679-b4ff-4ca1-84b2-18fce24e3358 None admin] RBAC: Authorizing `identity:create_grant(project_id=796ee44386c443e8885ece664a23534b, user_id=95d93f8e15b04d9e9eaa4401476755d5, role_id=f186b24dc4eb43668f180c85b7c1fc20)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:20.818061 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1c200679-b4ff-4ca1-84b2-18fce24e3358 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:20.844535 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 121/234] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 21 00:51:20 2022] PUT /identity/v3/projects/796ee44386c443e8885ece664a23534b/users/95d93f8e15b04d9e9eaa4401476755d5/roles/f186b24dc4eb43668f180c85b7c1fc20 => generated 0 bytes in 235 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 00:51:22.305838 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4784bc1-0cce-4184-b03d-91627fe6ef12 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:22.306361 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4784bc1-0cce-4184-b03d-91627fe6ef12 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:22.306789 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4784bc1-0cce-4184-b03d-91627fe6ef12 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:22.309654 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 114/235] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:22 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:22.317838 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8945e1-d7f8-4dd4-b1c0-de3f46a0ee17 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:22.318383 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8945e1-d7f8-4dd4-b1c0-de3f46a0ee17 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:22.318383 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc8945e1-d7f8-4dd4-b1c0-de3f46a0ee17 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:22.342607 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-fc8945e1-d7f8-4dd4-b1c0-de3f46a0ee17 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:22.343855 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-fc8945e1-d7f8-4dd4-b1c0-de3f46a0ee17 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:22.450580 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 122/236] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 134 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:22.719032 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfc8e6-5ab7-4363-b7f8-2aa4378ae84f None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:22.719498 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfc8e6-5ab7-4363-b7f8-2aa4378ae84f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:22.719981 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50dfc8e6-5ab7-4363-b7f8-2aa4378ae84f None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:22.722503 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 115/237] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:22.735206 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533cb0b-94b2-40f7-ba4e-b51a7d5279b0 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:22.735832 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533cb0b-94b2-40f7-ba4e-b51a7d5279b0 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:22.736291 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c533cb0b-94b2-40f7-ba4e-b51a7d5279b0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:22.761418 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-c533cb0b-94b2-40f7-ba4e-b51a7d5279b0 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:22.763221 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c533cb0b-94b2-40f7-ba4e-b51a7d5279b0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:22.862962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 123/238] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:22.921920 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a639315-aa73-408a-9774-5e0a5902ca18 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:22.922413 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a639315-aa73-408a-9774-5e0a5902ca18 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:22.922900 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a639315-aa73-408a-9774-5e0a5902ca18 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:22.925327 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 116/239] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:22 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:22.931505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d9650-15ae-4e73-b69b-6304e566fb52 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:22.932112 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d9650-15ae-4e73-b69b-6304e566fb52 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:22.932574 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492d9650-15ae-4e73-b69b-6304e566fb52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:22.962127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-492d9650-15ae-4e73-b69b-6304e566fb52 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:22.963719 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-492d9650-15ae-4e73-b69b-6304e566fb52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:22.970732 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a639315-aa73-408a-9774-5e0a5902ca18 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:22.986777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:23.167789 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 124/240] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:22 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 237 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:23.187198 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a639315-aa73-408a-9774-5e0a5902ca18 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:23.215045 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d9650-15ae-4e73-b69b-6304e566fb52 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:23.269119 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9ef6c-9146-45b4-aa03-eb6788541a07 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:23.270163 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9ef6c-9146-45b4-aa03-eb6788541a07 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:23.270640 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9ef6c-9146-45b4-aa03-eb6788541a07 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:23.271096 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccd9ef6c-9146-45b4-aa03-eb6788541a07 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:23.302474 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccd9ef6c-9146-45b4-aa03-eb6788541a07 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:23.310745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ccd9ef6c-9146-45b4-aa03-eb6788541a07 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:23.310745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:23.310745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:23.310745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:23.310745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:23.310745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:23.310745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:23.310745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:23.310745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:23.310745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:23.310745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:23.310745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:23.310745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:23.310745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:23.310745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:23.310745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:23.312108 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:23.312108 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:23.312108 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:23.312108 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:23.312108 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:23.312108 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:23.312108 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:23.312108 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:23.312108 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:23.312108 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:23.312108 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:23.312108 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:23.312108 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:23.312108 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:23.312108 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:23.312108 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:23.312872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:23.312872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:23.312872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:23.312872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:23.312872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:23.312872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:23.312872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:23.312872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:23.312872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:23.312872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:23.312872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:23.312872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:51:23.317769 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 117/241] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:51:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 348 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:23.326138 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9ef6c-9146-45b4-aa03-eb6788541a07 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:23.369110 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:23.453232 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492d9650-15ae-4e73-b69b-6304e566fb52 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:23.539215 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce801171-9d72-4a24-9e3a-459a9f73b8d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:23.540687 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce801171-9d72-4a24-9e3a-459a9f73b8d4 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:23.541381 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce801171-9d72-4a24-9e3a-459a9f73b8d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:23.542044 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce801171-9d72-4a24-9e3a-459a9f73b8d4 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:23.544286 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce801171-9d72-4a24-9e3a-459a9f73b8d4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:23.547456 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce801171-9d72-4a24-9e3a-459a9f73b8d4 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:23.551198 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 125/242] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:51:23 2022] GET /identity/v3/domains/default => generated 199 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:23.553848 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3bc65-e57e-44e6-91ba-56ec3d905fc2 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:23.554661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3bc65-e57e-44e6-91ba-56ec3d905fc2 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:23.555409 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ded3bc65-e57e-44e6-91ba-56ec3d905fc2 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:23.558707 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 126/243] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:23 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:23.566000 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3bc65-e57e-44e6-91ba-56ec3d905fc2 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:23.591258 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccd9ef6c-9146-45b4-aa03-eb6788541a07 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:23.598474 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:23.660140 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2f26084-a41d-4623-9e43-9e50230b1247 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:23.661188 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f26084-a41d-4623-9e43-9e50230b1247 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:23.661655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f26084-a41d-4623-9e43-9e50230b1247 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:23.662130 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2f26084-a41d-4623-9e43-9e50230b1247 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:23.663335 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f26084-a41d-4623-9e43-9e50230b1247 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:23.663827 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f26084-a41d-4623-9e43-9e50230b1247 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:23.666238 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2f26084-a41d-4623-9e43-9e50230b1247 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:23.682476 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 118/244] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:23 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 357 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:23.684815 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a74f7c-18f8-4fa5-8d08-c1b272d04a80 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:23.685335 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a74f7c-18f8-4fa5-8d08-c1b272d04a80 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:23.685784 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88a74f7c-18f8-4fa5-8d08-c1b272d04a80 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:23.711415 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ded3bc65-e57e-44e6-91ba-56ec3d905fc2 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:23.712780 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-88a74f7c-18f8-4fa5-8d08-c1b272d04a80 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:23.714584 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-88a74f7c-18f8-4fa5-8d08-c1b272d04a80 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:23.754356 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49d78c-770c-46ba-8ba3-46fa14dbe69f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:23.754973 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49d78c-770c-46ba-8ba3-46fa14dbe69f None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:23.755242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49d78c-770c-46ba-8ba3-46fa14dbe69f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:23.755505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a49d78c-770c-46ba-8ba3-46fa14dbe69f None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:23.756247 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49d78c-770c-46ba-8ba3-46fa14dbe69f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:23.757756 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a49d78c-770c-46ba-8ba3-46fa14dbe69f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:23.783128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 127/245] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 21 00:51:23 2022] POST /identity/v3/users => generated 293 bytes in 224 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:51:23.784050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49d78c-770c-46ba-8ba3-46fa14dbe69f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:23.821292 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 119/246] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:23 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 129 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:23.821292 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a74f7c-18f8-4fa5-8d08-c1b272d04a80 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:23.837403 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:23.985459 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:24.028878 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88a74f7c-18f8-4fa5-8d08-c1b272d04a80 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:24.052127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a49d78c-770c-46ba-8ba3-46fa14dbe69f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:24.072696 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb8267-ea7c-458b-8204-3cadd560c30c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:24.073320 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb8267-ea7c-458b-8204-3cadd560c30c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:24.073670 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb8267-ea7c-458b-8204-3cadd560c30c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:24.073979 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-afdb8267-ea7c-458b-8204-3cadd560c30c None admin] PATH_INFO: `/v3/users/95d93f8e15b04d9e9eaa4401476755d5` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:24.075274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb8267-ea7c-458b-8204-3cadd560c30c None admin] RBAC: Authorizing `identity:get_user(user_id=95d93f8e15b04d9e9eaa4401476755d5)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:24.076771 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-afdb8267-ea7c-458b-8204-3cadd560c30c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:24.078485 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 120/247] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:23 2022] GET /identity/v3/users/95d93f8e15b04d9e9eaa4401476755d5 => generated 283 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:24.090015 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb8267-ea7c-458b-8204-3cadd560c30c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:24.132413 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed67cc-862a-4b90-9357-3d723a3861d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:24.134060 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed67cc-862a-4b90-9357-3d723a3861d7 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:24.134918 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed67cc-862a-4b90-9357-3d723a3861d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:24.135053 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5aed67cc-862a-4b90-9357-3d723a3861d7 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:24.159147 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5aed67cc-862a-4b90-9357-3d723a3861d7 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:24.169593 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-5aed67cc-862a-4b90-9357-3d723a3861d7 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:24.169593 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:24.169593 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:24.169593 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:24.169593 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:24.169593 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:24.169593 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:24.169593 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:24.169593 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:24.169593 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:24.169593 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:24.169593 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:24.169593 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:24.169593 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:24.169593 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:24.169593 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:24.170632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:24.170632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:24.170632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:24.170632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:24.170632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:24.170632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:24.170632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:24.170632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:24.170632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:24.170632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:24.170632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:24.170632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:24.170632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:24.170632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:24.170632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:24.170632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:24.171444 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:24.171444 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:24.171444 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:24.171444 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:24.171444 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:24.171444 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:24.171444 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:24.171444 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:24.171444 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:24.171444 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:24.171444 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:24.171444 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:24.172064 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 128/248] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:23 2022] GET /identity/v3/roles/reader => generated 84 bytes in 388 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:24.173411 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed67cc-862a-4b90-9357-3d723a3861d7 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:24.201149 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:24.245352 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-afdb8267-ea7c-458b-8204-3cadd560c30c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:24.305723 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-107ff254-8333-45d1-8b25-0abfe1ed0d74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:24.306802 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ff254-8333-45d1-8b25-0abfe1ed0d74 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:24.307305 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ff254-8333-45d1-8b25-0abfe1ed0d74 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:24.307776 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-107ff254-8333-45d1-8b25-0abfe1ed0d74 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:24.361278 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5aed67cc-862a-4b90-9357-3d723a3861d7 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:24.411357 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ff254-8333-45d1-8b25-0abfe1ed0d74 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:24.413621 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-107ff254-8333-45d1-8b25-0abfe1ed0d74 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:24.415215 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:24.425227 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b0723-2eba-4fd3-8313-270728d88021 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:24.426495 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b0723-2eba-4fd3-8313-270728d88021 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:24.426789 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b0723-2eba-4fd3-8313-270728d88021 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:24.427264 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d0b0723-2eba-4fd3-8313-270728d88021 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:24.447756 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d0b0723-2eba-4fd3-8313-270728d88021 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:24.457165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-7d0b0723-2eba-4fd3-8313-270728d88021 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:24.457165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:24.457165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:24.457165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:24.457165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:24.457165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:24.457165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:24.457165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:24.457165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:24.457165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:24.457165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:24.457165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:24.457165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:24.457165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:24.457165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:24.457165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:24.458550 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:24.458550 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:24.458550 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:24.458550 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:24.458550 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:24.458550 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:24.458550 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:24.458550 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:24.458550 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:24.458550 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:24.458550 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:24.458550 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:24.458550 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:24.458550 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:24.458550 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:24.458550 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:24.459328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:24.459328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:24.459328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:24.459328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:24.459328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:24.459328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:24.459328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:24.459328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:24.459328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:24.459328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:24.459328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:24.459328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:24.459909 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 129/249] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:24 2022] GET /identity/v3/roles/member => generated 84 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:24.461006 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b0723-2eba-4fd3-8313-270728d88021 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:24.521166 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:24.554310 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 121/250] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:24 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 21 00:51:24.556376 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad507d-6eba-4bfc-a2e0-d0fe8ad83166 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:24.557022 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad507d-6eba-4bfc-a2e0-d0fe8ad83166 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:24.557649 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3ad507d-6eba-4bfc-a2e0-d0fe8ad83166 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:24.559681 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 122/251] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:24.560875 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad507d-6eba-4bfc-a2e0-d0fe8ad83166 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:24.601878 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d0b0723-2eba-4fd3-8313-270728d88021 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:24.642999 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc997832-a511-4dd4-86d8-f28a5ce51d41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:24.643552 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc997832-a511-4dd4-86d8-f28a5ce51d41 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:24.643826 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc997832-a511-4dd4-86d8-f28a5ce51d41 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:24.644099 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc997832-a511-4dd4-86d8-f28a5ce51d41 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:24.644790 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc997832-a511-4dd4-86d8-f28a5ce51d41 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:24.645119 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc997832-a511-4dd4-86d8-f28a5ce51d41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:24.646721 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc997832-a511-4dd4-86d8-f28a5ce51d41 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:24.656915 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 130/252] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:24 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:24.662374 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc997832-a511-4dd4-86d8-f28a5ce51d41 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:24.690435 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3ad507d-6eba-4bfc-a2e0-d0fe8ad83166 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:24.724128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:24.734187 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d81b1cc-18ed-449a-b5f4-fab56ee7d0f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:24.734972 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81b1cc-18ed-449a-b5f4-fab56ee7d0f5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:24.735346 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81b1cc-18ed-449a-b5f4-fab56ee7d0f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:24.735704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d81b1cc-18ed-449a-b5f4-fab56ee7d0f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:24.736488 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81b1cc-18ed-449a-b5f4-fab56ee7d0f5 None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:24.736889 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81b1cc-18ed-449a-b5f4-fab56ee7d0f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:24.740616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d81b1cc-18ed-449a-b5f4-fab56ee7d0f5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:24.753294 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 123/253] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:24 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:24.754878 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fff0e-e2d3-48e0-8d99-be55b69efbec None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:24.755321 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fff0e-e2d3-48e0-8d99-be55b69efbec None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:24.755682 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb0fff0e-e2d3-48e0-8d99-be55b69efbec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:24.776897 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-cb0fff0e-e2d3-48e0-8d99-be55b69efbec None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:24.778430 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-cb0fff0e-e2d3-48e0-8d99-be55b69efbec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:24.781070 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc997832-a511-4dd4-86d8-f28a5ce51d41 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:24.819402 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d05fe-691d-4e4c-8f1f-393ad1a29450 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:24.820342 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d05fe-691d-4e4c-8f1f-393ad1a29450 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:24.820759 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d05fe-691d-4e4c-8f1f-393ad1a29450 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:24.821228 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf8d05fe-691d-4e4c-8f1f-393ad1a29450 None admin] PATH_INFO: `/v3/projects/796ee44386c443e8885ece664a23534b` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:24.821593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:24.822906 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d05fe-691d-4e4c-8f1f-393ad1a29450 None admin] RBAC: Authorizing `identity:get_project(project_id=796ee44386c443e8885ece664a23534b)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:24.824834 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf8d05fe-691d-4e4c-8f1f-393ad1a29450 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:24.827015 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 131/254] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:24 2022] GET /identity/v3/projects/796ee44386c443e8885ece664a23534b => generated 302 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:24.828124 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d05fe-691d-4e4c-8f1f-393ad1a29450 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:24.881072 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 124/255] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:24 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:24.881072 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fff0e-e2d3-48e0-8d99-be55b69efbec None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:25.003301 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb0fff0e-e2d3-48e0-8d99-be55b69efbec None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:25.042011 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf8d05fe-691d-4e4c-8f1f-393ad1a29450 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:25.050228 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5597b-17ad-46a0-b06c-dfa95acb9ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:25.051621 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5597b-17ad-46a0-b06c-dfa95acb9ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:25.051621 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5597b-17ad-46a0-b06c-dfa95acb9ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:25.051621 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ae5597b-17ad-46a0-b06c-dfa95acb9ce2 None admin] PATH_INFO: `/v3/users/216a826ed0544041b19d313c7d9b4ce7` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:25.052620 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5597b-17ad-46a0-b06c-dfa95acb9ce2 None admin] RBAC: Authorizing `identity:get_user(user_id=216a826ed0544041b19d313c7d9b4ce7)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:25.054133 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ae5597b-17ad-46a0-b06c-dfa95acb9ce2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:25.057100 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 125/256] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:24 2022] GET /identity/v3/users/216a826ed0544041b19d313c7d9b4ce7 => generated 297 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:25.058027 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5597b-17ad-46a0-b06c-dfa95acb9ce2 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:25.114722 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:25.123489 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:25.173861 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1134d-3751-4aa5-8924-22ffb496d013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:25.174536 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1134d-3751-4aa5-8924-22ffb496d013 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:25.174822 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1134d-3751-4aa5-8924-22ffb496d013 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:25.175103 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8b1134d-3751-4aa5-8924-22ffb496d013 None admin] PATH_INFO: `/v3/users/05fad14f60ea49d893726cdad460d81d` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:25.219152 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1134d-3751-4aa5-8924-22ffb496d013 None admin] RBAC: Authorizing `identity:get_user(user_id=05fad14f60ea49d893726cdad460d81d)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:25.220463 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8b1134d-3751-4aa5-8924-22ffb496d013 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:25.222337 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 132/257] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:24 2022] GET /identity/v3/users/05fad14f60ea49d893726cdad460d81d => generated 297 bytes in 395 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:25.223165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1134d-3751-4aa5-8924-22ffb496d013 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:25.280877 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ae5597b-17ad-46a0-b06c-dfa95acb9ce2 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:25.357104 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccaae91-bbd3-43fc-9629-6d670389d161 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:25.358616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaae91-bbd3-43fc-9629-6d670389d161 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:25.359335 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaae91-bbd3-43fc-9629-6d670389d161 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:25.360068 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ccaae91-bbd3-43fc-9629-6d670389d161 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:25.361517 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccaae91-bbd3-43fc-9629-6d670389d161 None admin] RBAC: Adding query filter params (role.id=c73e9539582145ed8eedc48648b9d738, scope.project.id=796ee44386c443e8885ece664a23534b, user.id=95d93f8e15b04d9e9eaa4401476755d5) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:25.362218 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccaae91-bbd3-43fc-9629-6d670389d161 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:25.364853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ccaae91-bbd3-43fc-9629-6d670389d161 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:25.378530 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 126/258] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:25 2022] GET /identity/v3/role_assignments?user.id=95d93f8e15b04d9e9eaa4401476755d5&scope.project.id=796ee44386c443e8885ece664a23534b&role.id=c73e9539582145ed8eedc48648b9d738 => generated 608 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:25.380347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccaae91-bbd3-43fc-9629-6d670389d161 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:25.442168 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8b1134d-3751-4aa5-8924-22ffb496d013 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:25.501236 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418b212-cae2-4d10-a8aa-7f3eb3841e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:25.503637 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418b212-cae2-4d10-a8aa-7f3eb3841e26 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:25.504668 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418b212-cae2-4d10-a8aa-7f3eb3841e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:25.505665 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d418b212-cae2-4d10-a8aa-7f3eb3841e26 None admin] PATH_INFO: `/v3/projects/796ee44386c443e8885ece664a23534b` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:25.508178 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418b212-cae2-4d10-a8aa-7f3eb3841e26 None admin] RBAC: Authorizing `identity:get_project(project_id=796ee44386c443e8885ece664a23534b)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:25.512024 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d418b212-cae2-4d10-a8aa-7f3eb3841e26 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:25.515951 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 133/259] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:25 2022] GET /identity/v3/projects/796ee44386c443e8885ece664a23534b => generated 302 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:25.517968 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418b212-cae2-4d10-a8aa-7f3eb3841e26 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:25.539518 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ccaae91-bbd3-43fc-9629-6d670389d161 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:25.541464 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:25.579723 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e3025-33b2-4998-805e-5c95476b77c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:25.580396 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e3025-33b2-4998-805e-5c95476b77c9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:25.580673 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e3025-33b2-4998-805e-5c95476b77c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:25.580935 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d34e3025-33b2-4998-805e-5c95476b77c9 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:25.633214 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:25.660891 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e3025-33b2-4998-805e-5c95476b77c9 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:25.662451 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d34e3025-33b2-4998-805e-5c95476b77c9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:25.747968 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d418b212-cae2-4d10-a8aa-7f3eb3841e26 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:25.781792 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 127/260] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:25 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:25.782655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e3025-33b2-4998-805e-5c95476b77c9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:25.785298 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:25.826163 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de735193-a35f-48bd-961e-bdfe61003718 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:25.827874 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de735193-a35f-48bd-961e-bdfe61003718 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:25.828661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de735193-a35f-48bd-961e-bdfe61003718 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:25.829430 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de735193-a35f-48bd-961e-bdfe61003718 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:25.856351 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de735193-a35f-48bd-961e-bdfe61003718 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:25.867496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-de735193-a35f-48bd-961e-bdfe61003718 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:25.867496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:25.867496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:25.867496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:25.867496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:25.867496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:25.867496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:25.867496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:25.867496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:25.867496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:25.867496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:25.867496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:25.867496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:25.867496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:25.867496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:25.867496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:25.869311 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:25.869311 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:25.869311 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:25.869311 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:25.869311 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:25.869311 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:25.869311 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:25.869311 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:25.869311 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:25.869311 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:25.869311 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:25.869311 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:25.869311 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:25.869311 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:25.869311 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:25.869311 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:25.871037 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:25.871037 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:25.871037 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:25.871037 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:25.871037 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:25.871037 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:25.871037 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:25.871037 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:25.871037 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:25.871037 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:25.871037 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:25.871037 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:25.874487 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 134/261] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 21 00:51:25 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:25.876595 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de735193-a35f-48bd-961e-bdfe61003718 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:25.903696 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d34e3025-33b2-4998-805e-5c95476b77c9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:25.943367 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a91b71-8308-4b97-9106-614c68f03c4d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:25.944058 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a91b71-8308-4b97-9106-614c68f03c4d None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:25.944429 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a91b71-8308-4b97-9106-614c68f03c4d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:25.944676 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a91b71-8308-4b97-9106-614c68f03c4d None admin] PATH_INFO: `/v3/projects/796ee44386c443e8885ece664a23534b/users/216a826ed0544041b19d313c7d9b4ce7/roles/54545d831b9e469dad64f2d28c12e462` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:25.947020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a91b71-8308-4b97-9106-614c68f03c4d None admin] RBAC: Authorizing `identity:create_grant(project_id=796ee44386c443e8885ece664a23534b, user_id=216a826ed0544041b19d313c7d9b4ce7, role_id=54545d831b9e469dad64f2d28c12e462)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:25.949115 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a91b71-8308-4b97-9106-614c68f03c4d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:25.967477 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 128/262] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 21 00:51:25 2022] PUT /identity/v3/projects/796ee44386c443e8885ece664a23534b/users/216a826ed0544041b19d313c7d9b4ce7/roles/54545d831b9e469dad64f2d28c12e462 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:25.969085 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a91b71-8308-4b97-9106-614c68f03c4d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:26.077843 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:26.095945 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de735193-a35f-48bd-961e-bdfe61003718 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:26.141620 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:26.234729 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a91b71-8308-4b97-9106-614c68f03c4d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:26.261842 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3409d8-36be-4aaf-a79b-5da0b2d0b166 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:26.263437 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3409d8-36be-4aaf-a79b-5da0b2d0b166 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:26.264223 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3409d8-36be-4aaf-a79b-5da0b2d0b166 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:26.265037 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec3409d8-36be-4aaf-a79b-5da0b2d0b166 None admin] PATH_INFO: `/v3/projects/796ee44386c443e8885ece664a23534b` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:26.268989 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3409d8-36be-4aaf-a79b-5da0b2d0b166 None admin] RBAC: Authorizing `identity:get_project(project_id=796ee44386c443e8885ece664a23534b)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:26.272537 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec3409d8-36be-4aaf-a79b-5da0b2d0b166 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:26.278191 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 135/263] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:25 2022] GET /identity/v3/projects/796ee44386c443e8885ece664a23534b => generated 302 bytes in 403 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:26.290606 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3409d8-36be-4aaf-a79b-5da0b2d0b166 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:26.304934 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd88a07-7fdd-4d4a-9ea0-8a47b41a6aae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:26.305899 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd88a07-7fdd-4d4a-9ea0-8a47b41a6aae None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:26.306311 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd88a07-7fdd-4d4a-9ea0-8a47b41a6aae None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:26.306712 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fd88a07-7fdd-4d4a-9ea0-8a47b41a6aae None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:26.307972 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd88a07-7fdd-4d4a-9ea0-8a47b41a6aae None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:26.308500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd88a07-7fdd-4d4a-9ea0-8a47b41a6aae None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:26.311262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fd88a07-7fdd-4d4a-9ea0-8a47b41a6aae None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:26.329544 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 129/264] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:51:25 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 361 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:26.339406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd88a07-7fdd-4d4a-9ea0-8a47b41a6aae None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:26.576730 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec3409d8-36be-4aaf-a79b-5da0b2d0b166 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:26.605306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fd88a07-7fdd-4d4a-9ea0-8a47b41a6aae None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:26.656526 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ab9b9-d26b-4b4e-a42d-c99e9da20ee3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:26.657476 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:26.657657 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ab9b9-d26b-4b4e-a42d-c99e9da20ee3 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:26.657657 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ab9b9-d26b-4b4e-a42d-c99e9da20ee3 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:26.657899 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb5ab9b9-d26b-4b4e-a42d-c99e9da20ee3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:26.658532 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ab9b9-d26b-4b4e-a42d-c99e9da20ee3 None admin] RBAC: Adding query filter params (role.id=3ad6ad0ef7dd4a94be313f7b1074a82e, scope.project.id=796ee44386c443e8885ece664a23534b, user.id=05fad14f60ea49d893726cdad460d81d) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:26.658837 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ab9b9-d26b-4b4e-a42d-c99e9da20ee3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:26.660662 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb5ab9b9-d26b-4b4e-a42d-c99e9da20ee3 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:26.676469 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 136/265] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:26 2022] GET /identity/v3/role_assignments?user.id=05fad14f60ea49d893726cdad460d81d&scope.project.id=796ee44386c443e8885ece664a23534b&role.id=3ad6ad0ef7dd4a94be313f7b1074a82e => generated 259 bytes in 389 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:26.680029 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a4af3-0401-4ac5-bf51-42d0b9b59ed5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:26.680721 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a4af3-0401-4ac5-bf51-42d0b9b59ed5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:26.680999 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a4af3-0401-4ac5-bf51-42d0b9b59ed5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:26.681308 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af9a4af3-0401-4ac5-bf51-42d0b9b59ed5 None admin] PATH_INFO: `/v3/users/95d93f8e15b04d9e9eaa4401476755d5` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:26.682635 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a4af3-0401-4ac5-bf51-42d0b9b59ed5 None admin] RBAC: Authorizing `identity:get_user(user_id=95d93f8e15b04d9e9eaa4401476755d5)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:26.684240 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af9a4af3-0401-4ac5-bf51-42d0b9b59ed5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:26.686071 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 130/266] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:26 2022] GET /identity/v3/users/95d93f8e15b04d9e9eaa4401476755d5 => generated 283 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:26.695535 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ab9b9-d26b-4b4e-a42d-c99e9da20ee3 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:26.773701 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:26.889789 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb5ab9b9-d26b-4b4e-a42d-c99e9da20ee3 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:26.944755 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbb584-4b0e-4402-ade3-241b99726854 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:26.945473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbb584-4b0e-4402-ade3-241b99726854 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:26.945749 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbb584-4b0e-4402-ade3-241b99726854 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:26.946022 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-89cbb584-4b0e-4402-ade3-241b99726854 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:27.025952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbb584-4b0e-4402-ade3-241b99726854 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:27.027536 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-89cbb584-4b0e-4402-ade3-241b99726854 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:27.090450 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:27.139358 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 137/267] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:26 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 444 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 21 00:51:27.145940 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a4af3-0401-4ac5-bf51-42d0b9b59ed5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:27.409745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af9a4af3-0401-4ac5-bf51-42d0b9b59ed5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:27.459715 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47e8fc98-889f-4743-9abf-58b1ff8d42f6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:27.460386 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8fc98-889f-4743-9abf-58b1ff8d42f6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:27.460665 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8fc98-889f-4743-9abf-58b1ff8d42f6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:27.460938 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47e8fc98-889f-4743-9abf-58b1ff8d42f6 None admin] PATH_INFO: `/v3/projects/796ee44386c443e8885ece664a23534b` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:27.463476 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8fc98-889f-4743-9abf-58b1ff8d42f6 None admin] RBAC: Authorizing `identity:get_project(project_id=796ee44386c443e8885ece664a23534b)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:27.465130 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47e8fc98-889f-4743-9abf-58b1ff8d42f6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:27.467240 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 131/268] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:27 2022] GET /identity/v3/projects/796ee44386c443e8885ece664a23534b => generated 302 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:27.473835 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbb584-4b0e-4402-ade3-241b99726854 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:27.635466 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0615a12-ada3-4aac-a33b-792be25521c7 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:27.636363 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0615a12-ada3-4aac-a33b-792be25521c7 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:27.636363 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0615a12-ada3-4aac-a33b-792be25521c7 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:27.637768 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 132/269] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:27 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:27.645694 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d304e6-8b77-410c-944f-c085fe8ddf87 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:27.646183 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d304e6-8b77-410c-944f-c085fe8ddf87 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:27.646671 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71d304e6-8b77-410c-944f-c085fe8ddf87 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:27.653601 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-89cbb584-4b0e-4402-ade3-241b99726854 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:27.691588 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-71d304e6-8b77-410c-944f-c085fe8ddf87 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:27.692713 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-71d304e6-8b77-410c-944f-c085fe8ddf87 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:27.753222 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6400feba-0fe8-4323-85c8-98e62651a16e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:27.753871 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400feba-0fe8-4323-85c8-98e62651a16e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:27.754153 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400feba-0fe8-4323-85c8-98e62651a16e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:27.754422 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6400feba-0fe8-4323-85c8-98e62651a16e None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:27.755186 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400feba-0fe8-4323-85c8-98e62651a16e None admin] RBAC: Adding query filter params (role.id=f186b24dc4eb43668f180c85b7c1fc20, scope.project.id=796ee44386c443e8885ece664a23534b, user.id=95d93f8e15b04d9e9eaa4401476755d5) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:27.755549 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400feba-0fe8-4323-85c8-98e62651a16e None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:27.757221 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6400feba-0fe8-4323-85c8-98e62651a16e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:27.773754 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 138/270] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:27 2022] GET /identity/v3/role_assignments?user.id=95d93f8e15b04d9e9eaa4401476755d5&scope.project.id=796ee44386c443e8885ece664a23534b&role.id=f186b24dc4eb43668f180c85b7c1fc20 => generated 608 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:27.789501 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:27.816319 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 133/271] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 172 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:27.831015 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b14560-9171-4868-ab66-7cf41025fd7b None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:27.831533 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b14560-9171-4868-ab66-7cf41025fd7b None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:27.831961 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7b14560-9171-4868-ab66-7cf41025fd7b None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:27.835078 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 139/272] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:27 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:27.844707 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc48fdf-7110-4e26-b2e9-c0f467a8f398 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:27.845304 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc48fdf-7110-4e26-b2e9-c0f467a8f398 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:27.845811 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfc48fdf-7110-4e26-b2e9-c0f467a8f398 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:27.886939 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-bfc48fdf-7110-4e26-b2e9-c0f467a8f398 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:27.889178 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-bfc48fdf-7110-4e26-b2e9-c0f467a8f398 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:28.050133 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 134/273] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:27 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 207 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:28.234930 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b14560-9171-4868-ab66-7cf41025fd7b None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:28.242823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:28.433441 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc48fdf-7110-4e26-b2e9-c0f467a8f398 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:28.467918 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7b14560-9171-4868-ab66-7cf41025fd7b None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:28.549636 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d05896-0939-4a83-939c-d70cd81d955c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:28.550722 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d05896-0939-4a83-939c-d70cd81d955c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:28.551169 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d05896-0939-4a83-939c-d70cd81d955c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:28.551616 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9d05896-0939-4a83-939c-d70cd81d955c None admin] PATH_INFO: `/v3/domains/default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:28.554828 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d05896-0939-4a83-939c-d70cd81d955c None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:28.556644 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfc48fdf-7110-4e26-b2e9-c0f467a8f398 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:28.557337 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9d05896-0939-4a83-939c-d70cd81d955c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:28.561424 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 140/274] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:51:28 2022] GET /identity/v3/domains/default => generated 199 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:28.572977 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d05896-0939-4a83-939c-d70cd81d955c None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:28.593453 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:28.616787 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e436cc9-acab-46e2-b0ba-40323e6ed330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:28.617970 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e436cc9-acab-46e2-b0ba-40323e6ed330 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:28.618464 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e436cc9-acab-46e2-b0ba-40323e6ed330 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:28.618964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e436cc9-acab-46e2-b0ba-40323e6ed330 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:28.631919 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e436cc9-acab-46e2-b0ba-40323e6ed330 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:28.637328 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-4e436cc9-acab-46e2-b0ba-40323e6ed330 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:28.637328 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:28.637328 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:28.637328 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:28.637328 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:28.637328 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:28.637328 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:28.637328 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:28.637328 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:28.637328 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:28.637328 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:28.637328 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:28.637328 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:28.637328 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:28.637328 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:28.637328 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:28.638730 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:28.638730 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:28.638730 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:28.638730 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:28.638730 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:28.638730 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:28.638730 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:28.638730 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:28.638730 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:28.638730 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:28.638730 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:28.638730 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:28.638730 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:28.638730 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:28.638730 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:28.638730 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:28.639542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:28.639542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:28.639542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:28.639542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:28.639542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:28.639542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:28.639542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:28.639542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:28.639542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:28.639542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:28.639542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:28.639542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:51:28.647083 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 135/275] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:28 2022] GET /identity/v3/roles/member => generated 84 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:28.648586 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e436cc9-acab-46e2-b0ba-40323e6ed330 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:28.689841 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:28.731055 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9d05896-0939-4a83-939c-d70cd81d955c None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:28.782671 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58a30b-6f5e-491f-a9ce-eafb6a5aa8dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:28.783789 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58a30b-6f5e-491f-a9ce-eafb6a5aa8dd None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:28.784544 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58a30b-6f5e-491f-a9ce-eafb6a5aa8dd None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:28.785095 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8f58a30b-6f5e-491f-a9ce-eafb6a5aa8dd None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:28.786757 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58a30b-6f5e-491f-a9ce-eafb6a5aa8dd None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:28.788910 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8f58a30b-6f5e-491f-a9ce-eafb6a5aa8dd None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:28.823998 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 141/276] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 21 00:51:28 2022] POST /identity/v3/users => generated 293 bytes in 253 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:51:28.866189 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e436cc9-acab-46e2-b0ba-40323e6ed330 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:28.909572 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f92085-4d97-4b5a-9457-a5028ab3adff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:28.910231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f92085-4d97-4b5a-9457-a5028ab3adff None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:28.910512 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f92085-4d97-4b5a-9457-a5028ab3adff None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:28.910784 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42f92085-4d97-4b5a-9457-a5028ab3adff None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:28.911502 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f92085-4d97-4b5a-9457-a5028ab3adff None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:28.911815 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f92085-4d97-4b5a-9457-a5028ab3adff None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:28.913435 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42f92085-4d97-4b5a-9457-a5028ab3adff None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:28.924035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 136/277] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:28 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:28.930243 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58a30b-6f5e-491f-a9ce-eafb6a5aa8dd None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:29.059791 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8f58a30b-6f5e-491f-a9ce-eafb6a5aa8dd None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:29.094906 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:29.107742 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61542acd-1a3f-45b3-844a-79e27009dd50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:29.108414 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61542acd-1a3f-45b3-844a-79e27009dd50 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:29.108731 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61542acd-1a3f-45b3-844a-79e27009dd50 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:29.108968 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61542acd-1a3f-45b3-844a-79e27009dd50 None admin] PATH_INFO: `/v3/users/95240235dc564edf8dbf40018b1d4a3f` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:29.127811 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61542acd-1a3f-45b3-844a-79e27009dd50 None admin] RBAC: Authorizing `identity:get_user(user_id=95240235dc564edf8dbf40018b1d4a3f)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:29.129384 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61542acd-1a3f-45b3-844a-79e27009dd50 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:29.131590 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 142/278] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:28 2022] GET /identity/v3/users/95240235dc564edf8dbf40018b1d4a3f => generated 293 bytes in 202 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:29.137812 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f92085-4d97-4b5a-9457-a5028ab3adff None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:29.207738 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:29.337751 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42f92085-4d97-4b5a-9457-a5028ab3adff None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:29.363591 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a4fd2-3391-468a-9a44-a7d96edd1c14 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:29.364088 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a4fd2-3391-468a-9a44-a7d96edd1c14 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:29.364580 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f6a4fd2-3391-468a-9a44-a7d96edd1c14 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:29.371335 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 143/279] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:29 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:29.377818 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778cc26-ef9b-4fe6-9854-d1d14a91d283 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:29.378459 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778cc26-ef9b-4fe6-9854-d1d14a91d283 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:29.378943 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1778cc26-ef9b-4fe6-9854-d1d14a91d283 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:29.407878 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b0fc728-e1d3-4cfc-8094-f333e8b1b365 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:29.408844 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fc728-e1d3-4cfc-8094-f333e8b1b365 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:29.409342 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fc728-e1d3-4cfc-8094-f333e8b1b365 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:29.409552 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-1778cc26-ef9b-4fe6-9854-d1d14a91d283 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:29.409802 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b0fc728-e1d3-4cfc-8094-f333e8b1b365 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:29.411035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fc728-e1d3-4cfc-8094-f333e8b1b365 None admin] RBAC: Adding query filter params (role.id=54545d831b9e469dad64f2d28c12e462, user.id=95240235dc564edf8dbf40018b1d4a3f, scope.system=all) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:29.411438 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-1778cc26-ef9b-4fe6-9854-d1d14a91d283 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:29.411541 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fc728-e1d3-4cfc-8094-f333e8b1b365 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:29.414138 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b0fc728-e1d3-4cfc-8094-f333e8b1b365 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:29.425560 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 137/280] 10.222.0.49 () {56 vars in 1308 bytes} [Sun Aug 21 00:51:29 2022] GET /identity/v3/role_assignments?user.id=95240235dc564edf8dbf40018b1d4a3f&scope.system=all&role.id=54545d831b9e469dad64f2d28c12e462 => generated 226 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:29.559225 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315ea47-92dd-4e1e-9707-4702cdad79bb None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:29.560208 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315ea47-92dd-4e1e-9707-4702cdad79bb None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:29.560641 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5315ea47-92dd-4e1e-9707-4702cdad79bb None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:29.563655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 138/281] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:51:29.579517 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d531d-494e-4e4e-a35d-0af18694fa10 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:29.579743 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 144/282] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 203 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:29.579941 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d531d-494e-4e4e-a35d-0af18694fa10 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:29.580388 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-270d531d-494e-4e4e-a35d-0af18694fa10 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:29.624340 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-270d531d-494e-4e4e-a35d-0af18694fa10 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:29.626564 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-270d531d-494e-4e4e-a35d-0af18694fa10 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:29.757229 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 139/283] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:29.937925 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778cc26-ef9b-4fe6-9854-d1d14a91d283 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:30.084258 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1778cc26-ef9b-4fe6-9854-d1d14a91d283 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:30.102396 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:30.132576 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d3db9-308b-4444-a4b3-968556bc66b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:30.133259 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d3db9-308b-4444-a4b3-968556bc66b8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:30.133527 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d3db9-308b-4444-a4b3-968556bc66b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:30.133796 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba1d3db9-308b-4444-a4b3-968556bc66b8 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:30.145926 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba1d3db9-308b-4444-a4b3-968556bc66b8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:30.154970 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-ba1d3db9-308b-4444-a4b3-968556bc66b8 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:30.154970 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:30.154970 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:30.154970 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:30.154970 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:30.154970 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:30.154970 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:30.154970 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:30.154970 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:30.154970 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:30.154970 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:30.154970 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:30.154970 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:30.154970 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:30.154970 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:30.154970 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:30.156565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:30.156565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:30.156565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:30.156565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:30.156565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:30.156565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:30.156565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:30.156565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:30.156565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:30.156565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:30.156565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:30.156565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:30.156565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:30.156565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:30.156565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:30.156565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:30.158005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:30.158005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:30.158005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:30.158005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:30.158005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:30.158005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:30.158005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:30.158005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:30.158005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:30.158005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:30.158005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:30.158005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:30.158005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 145/284] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:29 2022] GET /identity/v3/roles/reader => generated 84 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:30.170793 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d531d-494e-4e4e-a35d-0af18694fa10 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:30.270849 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:30.330711 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d3db9-308b-4444-a4b3-968556bc66b8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:30.397282 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-270d531d-494e-4e4e-a35d-0af18694fa10 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:30.495850 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854c22c-cb2e-48d6-8ac2-ba9044f9f55b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:30.496377 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854c22c-cb2e-48d6-8ac2-ba9044f9f55b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:30.496654 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854c22c-cb2e-48d6-8ac2-ba9044f9f55b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:30.496918 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6854c22c-cb2e-48d6-8ac2-ba9044f9f55b None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:30.497661 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854c22c-cb2e-48d6-8ac2-ba9044f9f55b None admin] RBAC: Adding query filter params (name=reader) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:30.497960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854c22c-cb2e-48d6-8ac2-ba9044f9f55b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:30.499408 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6854c22c-cb2e-48d6-8ac2-ba9044f9f55b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:30.521445 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba1d3db9-308b-4444-a4b3-968556bc66b8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:30.535113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 140/285] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:30 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:30.543730 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854c22c-cb2e-48d6-8ac2-ba9044f9f55b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:30.638249 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18b156-6a2c-4b98-8e85-1b3f9798ac46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:30.639864 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18b156-6a2c-4b98-8e85-1b3f9798ac46 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:30.640679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18b156-6a2c-4b98-8e85-1b3f9798ac46 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:30.641507 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df18b156-6a2c-4b98-8e85-1b3f9798ac46 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:30.664371 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:30.669770 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6854c22c-cb2e-48d6-8ac2-ba9044f9f55b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:30.695240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df18b156-6a2c-4b98-8e85-1b3f9798ac46 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:30.711530 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f64d9-2668-4fc5-9a08-215c9ecaee86 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:30.712571 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f64d9-2668-4fc5-9a08-215c9ecaee86 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:30.712710 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-df18b156-6a2c-4b98-8e85-1b3f9798ac46 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:30.712710 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:30.712710 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:30.712710 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:30.712710 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:30.712710 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:30.712710 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:30.712710 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:30.712710 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:30.712710 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:30.712710 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:30.712710 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:30.712710 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:30.712710 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:30.712710 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:30.712710 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:30.713572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:30.713572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:30.713572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:30.713572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:30.713572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:30.713572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:30.713572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:30.713572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:30.713572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:30.713572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:30.713572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:30.713572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:30.713572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:30.713572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:30.713572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:30.713572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:30.714391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:30.714391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:30.714391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:30.714391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:30.714391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:30.714391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:30.714391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:30.714391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:30.714391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:30.714391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:30.714391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:30.714391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:30.715601 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 146/286] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:30 2022] GET /identity/v3/roles/member => generated 84 bytes in 386 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:51:30.716487 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f64d9-2668-4fc5-9a08-215c9ecaee86 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:30.717322 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d2f64d9-2668-4fc5-9a08-215c9ecaee86 None admin] PATH_INFO: `/v3/users/05fad14f60ea49d893726cdad460d81d` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:30.720138 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f64d9-2668-4fc5-9a08-215c9ecaee86 None admin] RBAC: Authorizing `identity:get_user(user_id=05fad14f60ea49d893726cdad460d81d)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:30.723901 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d2f64d9-2668-4fc5-9a08-215c9ecaee86 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:30.724498 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18b156-6a2c-4b98-8e85-1b3f9798ac46 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:30.727400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 141/287] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:30 2022] GET /identity/v3/users/05fad14f60ea49d893726cdad460d81d => generated 297 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:30.741870 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f64d9-2668-4fc5-9a08-215c9ecaee86 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:30.826480 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:30.996287 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df18b156-6a2c-4b98-8e85-1b3f9798ac46 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:31.064819 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d2f64d9-2668-4fc5-9a08-215c9ecaee86 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:31.068221 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd8ddc-0350-4c25-8ada-e9517fa916b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:31.068865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd8ddc-0350-4c25-8ada-e9517fa916b1 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:31.069207 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd8ddc-0350-4c25-8ada-e9517fa916b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:31.069497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3bd8ddc-0350-4c25-8ada-e9517fa916b1 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:31.070598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd8ddc-0350-4c25-8ada-e9517fa916b1 None admin] RBAC: Adding query filter params (name=member) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:31.071116 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd8ddc-0350-4c25-8ada-e9517fa916b1 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:31.073487 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3bd8ddc-0350-4c25-8ada-e9517fa916b1 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:31.107035 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 147/288] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:30 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 383 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:31.124999 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd8ddc-0350-4c25-8ada-e9517fa916b1 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:31.154230 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c36931-77bb-4124-a2b8-75f4250f7437 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:31.155389 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c36931-77bb-4124-a2b8-75f4250f7437 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:31.156084 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c36931-77bb-4124-a2b8-75f4250f7437 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:31.156630 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49c36931-77bb-4124-a2b8-75f4250f7437 None admin] PATH_INFO: `/v3/projects/796ee44386c443e8885ece664a23534b` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:31.158754 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c36931-77bb-4124-a2b8-75f4250f7437 None admin] RBAC: Authorizing `identity:get_project(project_id=796ee44386c443e8885ece664a23534b)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:31.161587 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49c36931-77bb-4124-a2b8-75f4250f7437 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:31.165207 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 142/289] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:30 2022] GET /identity/v3/projects/796ee44386c443e8885ece664a23534b => generated 302 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:31.176582 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c36931-77bb-4124-a2b8-75f4250f7437 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:31.224174 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:31.382073 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:31.392372 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3bd8ddc-0350-4c25-8ada-e9517fa916b1 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:31.397274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49c36931-77bb-4124-a2b8-75f4250f7437 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:31.437915 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd94a3-9d1d-43c0-8b1b-9ac87b9dbb8a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:31.438688 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd94a3-9d1d-43c0-8b1b-9ac87b9dbb8a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:31.438967 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd94a3-9d1d-43c0-8b1b-9ac87b9dbb8a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:31.439237 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2fd94a3-9d1d-43c0-8b1b-9ac87b9dbb8a None admin] PATH_INFO: `/v3/users/216a826ed0544041b19d313c7d9b4ce7` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:31.440524 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd94a3-9d1d-43c0-8b1b-9ac87b9dbb8a None admin] RBAC: Authorizing `identity:get_user(user_id=216a826ed0544041b19d313c7d9b4ce7)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:31.442197 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2fd94a3-9d1d-43c0-8b1b-9ac87b9dbb8a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:31.444245 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 148/290] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:31 2022] GET /identity/v3/users/216a826ed0544041b19d313c7d9b4ce7 => generated 297 bytes in 320 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:31.450934 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd94a3-9d1d-43c0-8b1b-9ac87b9dbb8a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:31.522356 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2368626-b20e-4afb-8bc6-09a3ae08fb13 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:31.523527 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2368626-b20e-4afb-8bc6-09a3ae08fb13 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:31.524030 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2368626-b20e-4afb-8bc6-09a3ae08fb13 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:31.524527 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2368626-b20e-4afb-8bc6-09a3ae08fb13 None admin] PATH_INFO: `/v3/projects/796ee44386c443e8885ece664a23534b/users/05fad14f60ea49d893726cdad460d81d/roles/3ad6ad0ef7dd4a94be313f7b1074a82e` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:31.534565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2368626-b20e-4afb-8bc6-09a3ae08fb13 None admin] RBAC: Authorizing `identity:create_grant(project_id=796ee44386c443e8885ece664a23534b, user_id=05fad14f60ea49d893726cdad460d81d, role_id=3ad6ad0ef7dd4a94be313f7b1074a82e)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:31.537419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2368626-b20e-4afb-8bc6-09a3ae08fb13 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:31.575125 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2fd94a3-9d1d-43c0-8b1b-9ac87b9dbb8a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:31.597129 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 143/291] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 21 00:51:31 2022] PUT /identity/v3/projects/796ee44386c443e8885ece664a23534b/users/05fad14f60ea49d893726cdad460d81d/roles/3ad6ad0ef7dd4a94be313f7b1074a82e => generated 0 bytes in 421 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:31.619323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f821a5-1f81-4b8a-a1d9-a2c083e11e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:31.620333 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f821a5-1f81-4b8a-a1d9-a2c083e11e08 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:31.620831 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f821a5-1f81-4b8a-a1d9-a2c083e11e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:31.621309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43f821a5-1f81-4b8a-a1d9-a2c083e11e08 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:31.669615 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:31.703941 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f821a5-1f81-4b8a-a1d9-a2c083e11e08 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:31.705815 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43f821a5-1f81-4b8a-a1d9-a2c083e11e08 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:31.828649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 149/292] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:31 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:31.834690 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2368626-b20e-4afb-8bc6-09a3ae08fb13 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:31.952104 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:31.961257 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2368626-b20e-4afb-8bc6-09a3ae08fb13 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:32.012917 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a6e0eba-d8fd-409b-a53c-09b3fbb73967 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:32.014042 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e0eba-d8fd-409b-a53c-09b3fbb73967 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:32.014538 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e0eba-d8fd-409b-a53c-09b3fbb73967 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:32.015017 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a6e0eba-d8fd-409b-a53c-09b3fbb73967 None admin] PATH_INFO: `/v3/projects/796ee44386c443e8885ece664a23534b` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:32.022052 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e0eba-d8fd-409b-a53c-09b3fbb73967 None admin] RBAC: Authorizing `identity:get_project(project_id=796ee44386c443e8885ece664a23534b)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:32.023730 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3a6e0eba-d8fd-409b-a53c-09b3fbb73967 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:32.026019 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 144/293] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:31 2022] GET /identity/v3/projects/796ee44386c443e8885ece664a23534b => generated 302 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:32.032324 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f821a5-1f81-4b8a-a1d9-a2c083e11e08 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:32.112401 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:32.156333 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43f821a5-1f81-4b8a-a1d9-a2c083e11e08 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:32.175713 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ded2e8-df39-4d4f-b79f-548a50952270 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:32.176487 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ded2e8-df39-4d4f-b79f-548a50952270 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:32.176487 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ded2e8-df39-4d4f-b79f-548a50952270 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:32.177971 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 145/294] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:32 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:51:32.183550 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c7c7b-2fb4-416e-929d-535d69ed7aa2 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:32.184190 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c7c7b-2fb4-416e-929d-535d69ed7aa2 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:32.184682 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a1c7c7b-2fb4-416e-929d-535d69ed7aa2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:32.216487 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3b29f4b4-1e94-40cb-a2f0-02dc488fb787 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:32.217518 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29f4b4-1e94-40cb-a2f0-02dc488fb787 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:32.218007 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29f4b4-1e94-40cb-a2f0-02dc488fb787 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:32.218490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b29f4b4-1e94-40cb-a2f0-02dc488fb787 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:32.219815 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29f4b4-1e94-40cb-a2f0-02dc488fb787 None admin] RBAC: Adding query filter params (role.id=54545d831b9e469dad64f2d28c12e462, scope.project.id=796ee44386c443e8885ece664a23534b, user.id=216a826ed0544041b19d313c7d9b4ce7) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:32.220792 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29f4b4-1e94-40cb-a2f0-02dc488fb787 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:32.229228 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3b29f4b4-1e94-40cb-a2f0-02dc488fb787 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:32.234055 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-4a1c7c7b-2fb4-416e-929d-535d69ed7aa2 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:32.234546 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 150/295] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:32 2022] GET /identity/v3/role_assignments?user.id=216a826ed0544041b19d313c7d9b4ce7&scope.project.id=796ee44386c443e8885ece664a23534b&role.id=54545d831b9e469dad64f2d28c12e462 => generated 608 bytes in 203 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:32.235814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4a1c7c7b-2fb4-416e-929d-535d69ed7aa2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:32.369265 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 146/296] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:32.646764 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8c735-47be-4ca2-8391-0a7673cdccbb None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:32.647110 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8c735-47be-4ca2-8391-0a7673cdccbb None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:32.647230 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c8c735-47be-4ca2-8391-0a7673cdccbb None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:32.649008 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 151/297] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:32.657032 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46df382-fcd4-468d-b8cf-d3899da11ff5 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:32.657368 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46df382-fcd4-468d-b8cf-d3899da11ff5 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:32.657623 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46df382-fcd4-468d-b8cf-d3899da11ff5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:32.692203 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e46df382-fcd4-468d-b8cf-d3899da11ff5 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:32.694237 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e46df382-fcd4-468d-b8cf-d3899da11ff5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:32.716351 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8c735-47be-4ca2-8391-0a7673cdccbb None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:32.853157 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 147/298] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:32 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:32.871816 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c8c735-47be-4ca2-8391-0a7673cdccbb None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:32.918265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:32.929074 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c46d1ccd-b62b-4f9d-94e3-6af6fc818a8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:32.930170 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d1ccd-b62b-4f9d-94e3-6af6fc818a8b None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:32.930668 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d1ccd-b62b-4f9d-94e3-6af6fc818a8b None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:32.931138 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c46d1ccd-b62b-4f9d-94e3-6af6fc818a8b None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:32.952042 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c46d1ccd-b62b-4f9d-94e3-6af6fc818a8b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:32.961520 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-c46d1ccd-b62b-4f9d-94e3-6af6fc818a8b None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:32.961520 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:32.961520 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:32.961520 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:32.961520 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:32.961520 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:32.961520 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:32.961520 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:32.961520 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:32.961520 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:32.961520 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:32.961520 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:32.961520 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:32.961520 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:32.961520 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:32.961520 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:32.962429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:32.962429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:32.962429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:32.962429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:32.962429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:32.962429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:32.962429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:32.962429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:32.962429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:32.962429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:32.962429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:32.962429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:32.962429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:32.962429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:32.962429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:32.962429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:32.963205 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:32.963205 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:32.963205 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:32.963205 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:32.963205 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:32.963205 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:32.963205 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:32.963205 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:32.963205 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:32.963205 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:32.963205 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:32.963205 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:32.963782 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 152/299] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:32 2022] GET /identity/v3/roles/reader => generated 84 bytes in 248 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:51:32.973476 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46df382-fcd4-468d-b8cf-d3899da11ff5 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:33.019845 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:33.149944 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc11832-f646-42e3-9ed2-1de1a2fb04e2 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:33.150751 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc11832-f646-42e3-9ed2-1de1a2fb04e2 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:33.150751 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dc11832-f646-42e3-9ed2-1de1a2fb04e2 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:33.152189 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 153/300] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:33.157727 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ac4af-c0fd-4632-9992-289ee9f14fa0 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:33.157975 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ac4af-c0fd-4632-9992-289ee9f14fa0 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:33.158284 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54ac4af-c0fd-4632-9992-289ee9f14fa0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:33.164709 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e46df382-fcd4-468d-b8cf-d3899da11ff5 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:33.177258 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-b54ac4af-c0fd-4632-9992-289ee9f14fa0 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:33.178375 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b54ac4af-c0fd-4632-9992-289ee9f14fa0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:33.225947 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeae4eb-9b80-4cc6-807f-d5bce8559321 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:33.226969 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeae4eb-9b80-4cc6-807f-d5bce8559321 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:33.227503 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeae4eb-9b80-4cc6-807f-d5bce8559321 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:33.227881 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2eeae4eb-9b80-4cc6-807f-d5bce8559321 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:33.229127 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeae4eb-9b80-4cc6-807f-d5bce8559321 None admin] RBAC: Adding query filter params (name=reader) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:33.229613 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeae4eb-9b80-4cc6-807f-d5bce8559321 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:33.232126 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2eeae4eb-9b80-4cc6-807f-d5bce8559321 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:33.248485 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 148/301] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:32 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:33.248485 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeae4eb-9b80-4cc6-807f-d5bce8559321 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:33.280801 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 154/302] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:33 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 124 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:33.289173 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ac4af-c0fd-4632-9992-289ee9f14fa0 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:33.388373 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:33.415683 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2eeae4eb-9b80-4cc6-807f-d5bce8559321 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:33.477808 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c22e95-6609-44a1-91db-92986cebe9ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:33.478456 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c22e95-6609-44a1-91db-92986cebe9ac None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:33.478735 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c22e95-6609-44a1-91db-92986cebe9ac None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:33.479008 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4c22e95-6609-44a1-91db-92986cebe9ac None admin] PATH_INFO: `/v3/domains/default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:33.481251 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c22e95-6609-44a1-91db-92986cebe9ac None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:33.482746 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4c22e95-6609-44a1-91db-92986cebe9ac None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:33.484793 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 149/303] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:51:33 2022] GET /identity/v3/domains/default => generated 199 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:33.490467 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c22e95-6609-44a1-91db-92986cebe9ac None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:33.498578 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54ac4af-c0fd-4632-9992-289ee9f14fa0 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:33.561137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1469935-efda-4338-a702-03e534367a04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:33.562489 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1469935-efda-4338-a702-03e534367a04 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:33.563109 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1469935-efda-4338-a702-03e534367a04 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:33.563680 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1469935-efda-4338-a702-03e534367a04 None admin] PATH_INFO: `/v3/users/02b5cc5f43624d5fab124e224984a298` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:33.565272 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:33.590734 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1469935-efda-4338-a702-03e534367a04 None admin] RBAC: Authorizing `identity:get_user(user_id=02b5cc5f43624d5fab124e224984a298)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:33.593821 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1469935-efda-4338-a702-03e534367a04 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:33.597325 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 155/304] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:33 2022] GET /identity/v3/users/02b5cc5f43624d5fab124e224984a298 => generated 293 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:33.604366 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4c22e95-6609-44a1-91db-92986cebe9ac None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:33.606574 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1469935-efda-4338-a702-03e534367a04 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:33.650191 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a480c-d872-43ae-af39-0c301d7906bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:33.650832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a480c-d872-43ae-af39-0c301d7906bb None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:33.651111 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a480c-d872-43ae-af39-0c301d7906bb None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:33.651382 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-750a480c-d872-43ae-af39-0c301d7906bb None admin] PATH_INFO: `/v3/groups` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:33.652099 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a480c-d872-43ae-af39-0c301d7906bb None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:33.653924 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-750a480c-d872-43ae-af39-0c301d7906bb None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:33.681311 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 150/305] 10.222.0.49 () {60 vars in 1134 bytes} [Sun Aug 21 00:51:33 2022] POST /identity/v3/groups => generated 229 bytes in 191 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:51:33.682763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a480c-d872-43ae-af39-0c301d7906bb None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:33.715712 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:33.785138 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1469935-efda-4338-a702-03e534367a04 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:33.853286 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20e2da-d5d3-4d88-8ddd-72bdd3921023 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:33.854539 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20e2da-d5d3-4d88-8ddd-72bdd3921023 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:33.855041 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20e2da-d5d3-4d88-8ddd-72bdd3921023 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:33.855524 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb20e2da-d5d3-4d88-8ddd-72bdd3921023 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:33.856761 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20e2da-d5d3-4d88-8ddd-72bdd3921023 None admin] RBAC: Adding query filter params (role.id=3ad6ad0ef7dd4a94be313f7b1074a82e, user.id=02b5cc5f43624d5fab124e224984a298, scope.system=all) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:33.857347 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20e2da-d5d3-4d88-8ddd-72bdd3921023 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:33.860032 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb20e2da-d5d3-4d88-8ddd-72bdd3921023 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:33.875312 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 156/306] 10.222.0.49 () {56 vars in 1308 bytes} [Sun Aug 21 00:51:33 2022] GET /identity/v3/role_assignments?user.id=02b5cc5f43624d5fab124e224984a298&scope.system=all&role.id=3ad6ad0ef7dd4a94be313f7b1074a82e => generated 226 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:33.891246 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-750a480c-d872-43ae-af39-0c301d7906bb None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:33.948727 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94157b4c-c629-4eae-8acc-ab96ce923fec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:33.949736 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94157b4c-c629-4eae-8acc-ab96ce923fec None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:33.950239 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94157b4c-c629-4eae-8acc-ab96ce923fec None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:33.950676 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94157b4c-c629-4eae-8acc-ab96ce923fec None admin] PATH_INFO: `/v3/roles/member` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:33.969392 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94157b4c-c629-4eae-8acc-ab96ce923fec None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:33.978725 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-94157b4c-c629-4eae-8acc-ab96ce923fec None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:33.978725 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:33.978725 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:33.978725 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:33.978725 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:33.978725 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:33.978725 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:33.978725 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:33.978725 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:33.978725 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:33.978725 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:33.978725 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:33.978725 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:33.978725 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:33.978725 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:33.978725 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:33.980455 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:33.980455 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:33.980455 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:33.980455 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:33.980455 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:33.980455 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:33.980455 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:33.980455 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:33.980455 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:33.980455 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:33.980455 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:33.980455 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:33.980455 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:33.980455 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:33.980455 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:33.980455 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:33.981978 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:33.981978 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:33.981978 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:33.981978 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:33.981978 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:33.981978 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:33.981978 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:33.981978 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:33.981978 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:33.981978 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:33.981978 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:33.981978 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:51:33.981978 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 151/307] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:33 2022] GET /identity/v3/roles/member => generated 84 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:33.990462 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20e2da-d5d3-4d88-8ddd-72bdd3921023 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:34.069330 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:34.169232 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb20e2da-d5d3-4d88-8ddd-72bdd3921023 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:34.224996 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de961d-3db3-43b1-ac8c-7e700dd08638 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:34.225507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de961d-3db3-43b1-ac8c-7e700dd08638 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:34.225983 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10de961d-3db3-43b1-ac8c-7e700dd08638 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:34.229343 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 152/308] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:34.238791 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313d5ca-60a9-4d78-8dfa-ae407e27d886 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:34.239242 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313d5ca-60a9-4d78-8dfa-ae407e27d886 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:34.239699 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c313d5ca-60a9-4d78-8dfa-ae407e27d886 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:34.241780 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44154ca0-964b-4ee7-8373-8374c59dcd96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:34.242686 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44154ca0-964b-4ee7-8373-8374c59dcd96 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:34.243204 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44154ca0-964b-4ee7-8373-8374c59dcd96 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:34.243672 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44154ca0-964b-4ee7-8373-8374c59dcd96 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:34.244558 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44154ca0-964b-4ee7-8373-8374c59dcd96 None admin] RBAC: Adding query filter params (name=member) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:34.245088 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44154ca0-964b-4ee7-8373-8374c59dcd96 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:34.247025 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44154ca0-964b-4ee7-8373-8374c59dcd96 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:34.257717 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 157/309] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:33 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:34.266795 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44154ca0-964b-4ee7-8373-8374c59dcd96 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:34.271875 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-c313d5ca-60a9-4d78-8dfa-ae407e27d886 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:34.273516 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c313d5ca-60a9-4d78-8dfa-ae407e27d886 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:34.368949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 153/310] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:34 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:34.468261 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44154ca0-964b-4ee7-8373-8374c59dcd96 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:34.472926 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:34.533789 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc7568-5d2c-4a82-8ca9-731e82a06b3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:34.534858 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc7568-5d2c-4a82-8ca9-731e82a06b3c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:34.535340 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc7568-5d2c-4a82-8ca9-731e82a06b3c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:34.535806 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdcc7568-5d2c-4a82-8ca9-731e82a06b3c None admin] PATH_INFO: `/v3/users/95240235dc564edf8dbf40018b1d4a3f` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:34.537884 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc7568-5d2c-4a82-8ca9-731e82a06b3c None admin] RBAC: Authorizing `identity:get_user(user_id=95240235dc564edf8dbf40018b1d4a3f)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:34.540523 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdcc7568-5d2c-4a82-8ca9-731e82a06b3c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:34.547766 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 158/311] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:34 2022] GET /identity/v3/users/95240235dc564edf8dbf40018b1d4a3f => generated 293 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:34.554221 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313d5ca-60a9-4d78-8dfa-ae407e27d886 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:34.558382 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:34.644482 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc7568-5d2c-4a82-8ca9-731e82a06b3c None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:34.665284 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c313d5ca-60a9-4d78-8dfa-ae407e27d886 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:34.712336 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52811e97-3318-4299-842c-482d1e6c822d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:34.713940 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52811e97-3318-4299-842c-482d1e6c822d None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:34.714273 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52811e97-3318-4299-842c-482d1e6c822d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:34.714559 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52811e97-3318-4299-842c-482d1e6c822d None admin] PATH_INFO: `/v3/system/users/95240235dc564edf8dbf40018b1d4a3f/roles/54545d831b9e469dad64f2d28c12e462` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:34.716734 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52811e97-3318-4299-842c-482d1e6c822d None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=95240235dc564edf8dbf40018b1d4a3f, role_id=54545d831b9e469dad64f2d28c12e462)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:34.719638 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52811e97-3318-4299-842c-482d1e6c822d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:34.746021 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 154/312] 10.222.0.49 () {58 vars in 1334 bytes} [Sun Aug 21 00:51:34 2022] PUT /identity/v3/system/users/95240235dc564edf8dbf40018b1d4a3f/roles/54545d831b9e469dad64f2d28c12e462 => generated 0 bytes in 185 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:34.814514 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdcc7568-5d2c-4a82-8ca9-731e82a06b3c None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:34.879099 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12751f42-d948-4c26-b22d-efbe59b6147a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:34.880699 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12751f42-d948-4c26-b22d-efbe59b6147a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:34.881494 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12751f42-d948-4c26-b22d-efbe59b6147a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:34.882271 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12751f42-d948-4c26-b22d-efbe59b6147a None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:34.904541 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12751f42-d948-4c26-b22d-efbe59b6147a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:34.916496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-12751f42-d948-4c26-b22d-efbe59b6147a None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:34.916496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:34.916496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:34.916496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:34.916496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:34.916496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:34.916496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:34.916496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:34.916496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:34.916496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:34.916496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:34.916496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:34.916496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:34.916496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:34.916496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:34.916496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:34.918560 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:34.918560 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:34.918560 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:34.918560 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:34.918560 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:34.918560 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:34.918560 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:34.918560 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:34.918560 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:34.918560 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:34.918560 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:34.918560 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:34.918560 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:34.918560 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:34.918560 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:34.918560 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:34.920050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:34.920050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:34.920050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:34.920050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:34.920050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:34.920050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:34.920050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:34.920050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:34.920050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:34.920050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:34.920050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:34.920050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:34.924247 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 159/313] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:34 2022] GET /identity/v3/roles/reader => generated 84 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:34.930658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52811e97-3318-4299-842c-482d1e6c822d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:35.012381 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:35.055861 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52811e97-3318-4299-842c-482d1e6c822d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:35.099305 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb2762-5551-4ed7-979a-d3e002b7480c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:35.099926 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb2762-5551-4ed7-979a-d3e002b7480c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:35.100214 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb2762-5551-4ed7-979a-d3e002b7480c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:35.100478 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5adb2762-5551-4ed7-979a-d3e002b7480c None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:35.101192 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb2762-5551-4ed7-979a-d3e002b7480c None admin] RBAC: Adding query filter params (name=reader) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:35.101497 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb2762-5551-4ed7-979a-d3e002b7480c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:35.102912 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5adb2762-5551-4ed7-979a-d3e002b7480c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:35.112671 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 155/314] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:34 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:35.118192 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12751f42-d948-4c26-b22d-efbe59b6147a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:35.157832 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:35.282101 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12751f42-d948-4c26-b22d-efbe59b6147a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:35.343193 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5ddd5-cfd7-4d5c-9fa3-706141b13899 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:35.344238 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5ddd5-cfd7-4d5c-9fa3-706141b13899 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:35.344701 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5ddd5-cfd7-4d5c-9fa3-706141b13899 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:35.345214 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81c5ddd5-cfd7-4d5c-9fa3-706141b13899 None admin] PATH_INFO: `/v3/users/05fad14f60ea49d893726cdad460d81d` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:35.347193 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5ddd5-cfd7-4d5c-9fa3-706141b13899 None admin] RBAC: Authorizing `identity:get_user(user_id=05fad14f60ea49d893726cdad460d81d)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:35.349796 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81c5ddd5-cfd7-4d5c-9fa3-706141b13899 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:35.353249 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 160/315] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:35 2022] GET /identity/v3/users/05fad14f60ea49d893726cdad460d81d => generated 297 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:35.359101 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb2762-5551-4ed7-979a-d3e002b7480c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:35.528707 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5adb2762-5551-4ed7-979a-d3e002b7480c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:35.559800 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:35.570587 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a5c7d-0362-4358-bc72-f39da559ef12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:35.571258 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a5c7d-0362-4358-bc72-f39da559ef12 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:35.571535 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a5c7d-0362-4358-bc72-f39da559ef12 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:35.571805 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e9a5c7d-0362-4358-bc72-f39da559ef12 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:35.650585 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a5c7d-0362-4358-bc72-f39da559ef12 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:35.652212 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e9a5c7d-0362-4358-bc72-f39da559ef12 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:35.766767 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 156/316] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:35 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 408 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:35.772695 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5ddd5-cfd7-4d5c-9fa3-706141b13899 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:35.947012 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:35.952380 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81c5ddd5-cfd7-4d5c-9fa3-706141b13899 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:35.991072 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3719efe-f2d2-4327-a2f7-17044446e0d4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:35.991732 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3719efe-f2d2-4327-a2f7-17044446e0d4 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:35.992018 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3719efe-f2d2-4327-a2f7-17044446e0d4 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:35.992273 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3719efe-f2d2-4327-a2f7-17044446e0d4 None admin] PATH_INFO: `/v3/projects/796ee44386c443e8885ece664a23534b` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:35.993533 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3719efe-f2d2-4327-a2f7-17044446e0d4 None admin] RBAC: Authorizing `identity:get_project(project_id=796ee44386c443e8885ece664a23534b)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:35.995085 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3719efe-f2d2-4327-a2f7-17044446e0d4 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:35.997304 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 161/317] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:35 2022] GET /identity/v3/projects/796ee44386c443e8885ece664a23534b => generated 302 bytes in 225 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:36.007439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a5c7d-0362-4358-bc72-f39da559ef12 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:36.053657 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:36.137747 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e9a5c7d-0362-4358-bc72-f39da559ef12 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:36.176473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66332139-8a73-4ea8-a7a6-9d729f9d6fb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:36.177117 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66332139-8a73-4ea8-a7a6-9d729f9d6fb8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:36.177406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66332139-8a73-4ea8-a7a6-9d729f9d6fb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:36.177679 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66332139-8a73-4ea8-a7a6-9d729f9d6fb8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:36.178470 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66332139-8a73-4ea8-a7a6-9d729f9d6fb8 None admin] RBAC: Adding query filter params (role.id=3ad6ad0ef7dd4a94be313f7b1074a82e, scope.project.id=796ee44386c443e8885ece664a23534b, user.id=05fad14f60ea49d893726cdad460d81d) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:36.178793 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66332139-8a73-4ea8-a7a6-9d729f9d6fb8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:36.180260 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66332139-8a73-4ea8-a7a6-9d729f9d6fb8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:36.187550 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 157/318] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:51:36 2022] GET /identity/v3/role_assignments?user.id=05fad14f60ea49d893726cdad460d81d&scope.project.id=796ee44386c443e8885ece664a23534b&role.id=3ad6ad0ef7dd4a94be313f7b1074a82e => generated 608 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:36.301905 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446cf07-a1fd-4ad8-a199-3d31c92704f9 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:36.302663 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446cf07-a1fd-4ad8-a199-3d31c92704f9 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:36.302663 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7446cf07-a1fd-4ad8-a199-3d31c92704f9 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:36.304241 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 162/319] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:36.310679 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb57cf-2f24-4c4d-a0e9-816bf35058e6 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:36.311117 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb57cf-2f24-4c4d-a0e9-816bf35058e6 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:36.311298 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26eb57cf-2f24-4c4d-a0e9-816bf35058e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:36.332405 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-26eb57cf-2f24-4c4d-a0e9-816bf35058e6 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:36.333732 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-26eb57cf-2f24-4c4d-a0e9-816bf35058e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:36.422053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 158/320] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 112 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:36.665698 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e101353-65f8-4834-988c-2eaf894b39e3 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:36.666125 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e101353-65f8-4834-988c-2eaf894b39e3 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:36.666587 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e101353-65f8-4834-988c-2eaf894b39e3 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:36.669593 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 163/321] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:36 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:36.678592 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6b58d-1dcc-4a43-a96c-6ac8b5210285 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:36.679073 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6b58d-1dcc-4a43-a96c-6ac8b5210285 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:36.679547 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81f6b58d-1dcc-4a43-a96c-6ac8b5210285 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:36.710582 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-81f6b58d-1dcc-4a43-a96c-6ac8b5210285 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:36.712704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-81f6b58d-1dcc-4a43-a96c-6ac8b5210285 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:36.735232 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e101353-65f8-4834-988c-2eaf894b39e3 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:36.748478 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:36.852387 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 159/322] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 176 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:36.939046 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e101353-65f8-4834-988c-2eaf894b39e3 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:37.007865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9c94e-cefb-44bd-852c-57fe74e9dfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:37.009348 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9c94e-cefb-44bd-852c-57fe74e9dfa1 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:37.010051 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9c94e-cefb-44bd-852c-57fe74e9dfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:37.010720 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcf9c94e-cefb-44bd-852c-57fe74e9dfa1 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:37.013130 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf9c94e-cefb-44bd-852c-57fe74e9dfa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:37.016123 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcf9c94e-cefb-44bd-852c-57fe74e9dfa1 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:37.019992 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 164/323] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:51:36 2022] GET /identity/v3/domains/default => generated 199 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:37.026795 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6b58d-1dcc-4a43-a96c-6ac8b5210285 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:37.135023 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9c94e-cefb-44bd-852c-57fe74e9dfa1 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:37.161455 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81f6b58d-1dcc-4a43-a96c-6ac8b5210285 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:37.199652 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:37.201492 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55aedcf6-2070-4030-8dca-91713aadb50d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:37.202280 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aedcf6-2070-4030-8dca-91713aadb50d None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:37.202489 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aedcf6-2070-4030-8dca-91713aadb50d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:37.202755 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55aedcf6-2070-4030-8dca-91713aadb50d None admin] PATH_INFO: `/v3/groups` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:37.203398 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aedcf6-2070-4030-8dca-91713aadb50d None admin] RBAC: Authorizing `identity:create_group()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:37.204893 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55aedcf6-2070-4030-8dca-91713aadb50d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:37.224958 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 160/324] 10.222.0.49 () {60 vars in 1134 bytes} [Sun Aug 21 00:51:37 2022] POST /identity/v3/groups => generated 226 bytes in 199 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:51:37.342320 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcf9c94e-cefb-44bd-852c-57fe74e9dfa1 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:37.405014 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee7bac-ebde-4b33-a179-d4e2d472f971 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:37.406127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee7bac-ebde-4b33-a179-d4e2d472f971 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:37.406558 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee7bac-ebde-4b33-a179-d4e2d472f971 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:37.407032 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0ee7bac-ebde-4b33-a179-d4e2d472f971 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:37.425956 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0ee7bac-ebde-4b33-a179-d4e2d472f971 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:37.435872 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-d0ee7bac-ebde-4b33-a179-d4e2d472f971 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:37.435872 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:37.435872 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:37.435872 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:37.435872 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:37.435872 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:37.435872 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:37.435872 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:37.435872 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:37.435872 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:37.435872 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:37.435872 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:37.435872 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:37.435872 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:37.435872 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:37.435872 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:37.436811 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:37.436811 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:37.436811 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:37.436811 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:37.436811 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:37.436811 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:37.436811 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:37.436811 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:37.436811 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:37.436811 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:37.436811 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:37.436811 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:37.436811 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:37.436811 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:37.436811 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:37.436811 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:37.437616 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:37.437616 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:37.437616 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:37.437616 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:37.437616 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:37.437616 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:37.437616 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:37.437616 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:37.437616 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:37.437616 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:37.437616 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:37.437616 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:37.438203 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 165/325] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:37 2022] GET /identity/v3/roles/reader => generated 84 bytes in 305 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:37.444323 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57faea-fdef-4b0d-affc-244d080cf35b None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:37.444988 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57faea-fdef-4b0d-affc-244d080cf35b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:37.444988 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d57faea-fdef-4b0d-affc-244d080cf35b None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:37.446276 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 161/326] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:37.447472 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee7bac-ebde-4b33-a179-d4e2d472f971 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:37.452027 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01141b1e-e875-4061-a73a-ed74ec78e2ab None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:37.452251 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01141b1e-e875-4061-a73a-ed74ec78e2ab None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:37.452531 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01141b1e-e875-4061-a73a-ed74ec78e2ab None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:37.472712 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-01141b1e-e875-4061-a73a-ed74ec78e2ab None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:37.473991 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-01141b1e-e875-4061-a73a-ed74ec78e2ab None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:37.483415 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:37.582669 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 162/327] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:37 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 131 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:37.630630 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:37.635438 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0ee7bac-ebde-4b33-a179-d4e2d472f971 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:37.681516 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78030a5e-2aaf-4296-933a-a7d5f53650cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:37.682159 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78030a5e-2aaf-4296-933a-a7d5f53650cd None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:37.682439 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78030a5e-2aaf-4296-933a-a7d5f53650cd None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:37.682714 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78030a5e-2aaf-4296-933a-a7d5f53650cd None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:37.683490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78030a5e-2aaf-4296-933a-a7d5f53650cd None admin] RBAC: Adding query filter params (name=reader) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:37.683797 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78030a5e-2aaf-4296-933a-a7d5f53650cd None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:37.685312 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78030a5e-2aaf-4296-933a-a7d5f53650cd None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:37.697957 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 166/328] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:37 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:37.706289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01141b1e-e875-4061-a73a-ed74ec78e2ab None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:37.828657 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01141b1e-e875-4061-a73a-ed74ec78e2ab None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:37.872991 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78030a5e-2aaf-4296-933a-a7d5f53650cd None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:37.879900 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73283e7-25f6-49b1-9c82-62f9033bbe3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:37.881780 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73283e7-25f6-49b1-9c82-62f9033bbe3c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:37.882062 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73283e7-25f6-49b1-9c82-62f9033bbe3c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:37.882328 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c73283e7-25f6-49b1-9c82-62f9033bbe3c None admin] PATH_INFO: `/v3/users/02b5cc5f43624d5fab124e224984a298` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:37.884586 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73283e7-25f6-49b1-9c82-62f9033bbe3c None admin] RBAC: Authorizing `identity:get_user(user_id=02b5cc5f43624d5fab124e224984a298)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:37.886179 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c73283e7-25f6-49b1-9c82-62f9033bbe3c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:37.888147 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 163/329] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:37 2022] GET /identity/v3/users/02b5cc5f43624d5fab124e224984a298 => generated 293 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:37.893949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73283e7-25f6-49b1-9c82-62f9033bbe3c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:37.911297 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:38.037265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78030a5e-2aaf-4296-933a-a7d5f53650cd None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:38.122070 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00defc2a-f566-4d62-8e55-784fb267146f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:38.122308 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c73283e7-25f6-49b1-9c82-62f9033bbe3c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:38.123142 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00defc2a-f566-4d62-8e55-784fb267146f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:38.123634 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00defc2a-f566-4d62-8e55-784fb267146f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:38.124100 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00defc2a-f566-4d62-8e55-784fb267146f None admin] PATH_INFO: `/v3/roles/member` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:38.147683 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00defc2a-f566-4d62-8e55-784fb267146f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:38.153200 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-00defc2a-f566-4d62-8e55-784fb267146f None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:38.153200 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:38.153200 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:38.153200 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:38.153200 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:38.153200 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:38.153200 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:38.153200 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:38.153200 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:38.153200 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:38.153200 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:38.153200 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:38.153200 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:38.153200 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:38.153200 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:38.153200 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:38.154120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:38.154120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:38.154120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:38.154120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:38.154120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:38.154120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:38.154120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:38.154120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:38.154120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:38.154120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:38.154120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:38.154120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:38.154120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:38.154120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:38.154120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:38.154120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:38.154895 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:38.154895 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:38.154895 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:38.154895 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:38.154895 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:38.154895 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:38.154895 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:38.154895 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:38.154895 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:38.154895 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:38.154895 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:38.154895 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:38.154895 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 167/330] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:37 2022] GET /identity/v3/roles/member => generated 84 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:38.162338 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00defc2a-f566-4d62-8e55-784fb267146f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:38.202138 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:38.221262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f2126-2a9d-4efd-987e-e7bcf96111e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:38.222718 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f2126-2a9d-4efd-987e-e7bcf96111e2 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:38.223203 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f2126-2a9d-4efd-987e-e7bcf96111e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:38.223684 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad4f2126-2a9d-4efd-987e-e7bcf96111e2 None admin] PATH_INFO: `/v3/system/users/02b5cc5f43624d5fab124e224984a298/roles/3ad6ad0ef7dd4a94be313f7b1074a82e` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:38.231248 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f2126-2a9d-4efd-987e-e7bcf96111e2 None admin] RBAC: Authorizing `identity:create_system_grant_for_user(user_id=02b5cc5f43624d5fab124e224984a298, role_id=3ad6ad0ef7dd4a94be313f7b1074a82e)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:38.235302 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad4f2126-2a9d-4efd-987e-e7bcf96111e2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:38.254074 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 164/331] 10.222.0.49 () {58 vars in 1334 bytes} [Sun Aug 21 00:51:37 2022] PUT /identity/v3/system/users/02b5cc5f43624d5fab124e224984a298/roles/3ad6ad0ef7dd4a94be313f7b1074a82e => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 00:51:38.413146 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00defc2a-f566-4d62-8e55-784fb267146f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:38.496111 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80026e-3143-4c64-8196-753d5c2432c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:38.497219 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80026e-3143-4c64-8196-753d5c2432c9 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:38.497719 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80026e-3143-4c64-8196-753d5c2432c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:38.498203 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea80026e-3143-4c64-8196-753d5c2432c9 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:38.499456 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80026e-3143-4c64-8196-753d5c2432c9 None admin] RBAC: Adding query filter params (name=member) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:38.500004 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80026e-3143-4c64-8196-753d5c2432c9 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:38.503007 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea80026e-3143-4c64-8196-753d5c2432c9 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:38.524405 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 168/332] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:38 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 363 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:38.530046 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f2126-2a9d-4efd-987e-e7bcf96111e2 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:38.689091 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:38.739571 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad4f2126-2a9d-4efd-987e-e7bcf96111e2 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:38.806439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-076c9037-965a-46f7-8b86-7a13a0a71e93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:38.807477 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c9037-965a-46f7-8b86-7a13a0a71e93 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:38.807968 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c9037-965a-46f7-8b86-7a13a0a71e93 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:38.808411 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-076c9037-965a-46f7-8b86-7a13a0a71e93 None admin] PATH_INFO: `/v3/users/95240235dc564edf8dbf40018b1d4a3f` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:38.814389 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c9037-965a-46f7-8b86-7a13a0a71e93 None admin] RBAC: Authorizing `identity:get_user(user_id=95240235dc564edf8dbf40018b1d4a3f)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:38.816933 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-076c9037-965a-46f7-8b86-7a13a0a71e93 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:38.820269 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 165/333] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:38 2022] GET /identity/v3/users/95240235dc564edf8dbf40018b1d4a3f => generated 293 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:38.827322 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80026e-3143-4c64-8196-753d5c2432c9 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:39.002593 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:39.041147 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea80026e-3143-4c64-8196-753d5c2432c9 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:39.092855 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-18c0da82-3f7f-4c2c-8018-eb0a653ad125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:39.093513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0da82-3f7f-4c2c-8018-eb0a653ad125 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:39.093792 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0da82-3f7f-4c2c-8018-eb0a653ad125 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:39.094064 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-18c0da82-3f7f-4c2c-8018-eb0a653ad125 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:39.094805 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0da82-3f7f-4c2c-8018-eb0a653ad125 None admin] RBAC: Adding query filter params (role.id=54545d831b9e469dad64f2d28c12e462, user.id=95240235dc564edf8dbf40018b1d4a3f, scope.system=all) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:39.095110 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0da82-3f7f-4c2c-8018-eb0a653ad125 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:39.096666 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-18c0da82-3f7f-4c2c-8018-eb0a653ad125 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:39.117328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 169/334] 10.222.0.49 () {56 vars in 1308 bytes} [Sun Aug 21 00:51:38 2022] GET /identity/v3/role_assignments?user.id=95240235dc564edf8dbf40018b1d4a3f&scope.system=all&role.id=54545d831b9e469dad64f2d28c12e462 => generated 510 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:40.315315 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f779ee5-0d34-40a9-891d-8168e1e12b1e None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:40.315910 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f779ee5-0d34-40a9-891d-8168e1e12b1e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:40.316374 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f779ee5-0d34-40a9-891d-8168e1e12b1e None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:40.319019 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 166/335] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:40 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:40.346727 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4e600-0ae1-42dc-84d5-c7525ab79001 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:40.347270 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4e600-0ae1-42dc-84d5-c7525ab79001 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:40.347684 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-72f4e600-0ae1-42dc-84d5-c7525ab79001 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:40.394736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-72f4e600-0ae1-42dc-84d5-c7525ab79001 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:40.396738 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-72f4e600-0ae1-42dc-84d5-c7525ab79001 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:40.546791 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 170/336] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:40.852345 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e727227-29be-45e9-9213-bb8ebca392c0 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:40.852734 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e727227-29be-45e9-9213-bb8ebca392c0 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:40.853231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e727227-29be-45e9-9213-bb8ebca392c0 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:40.855780 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 167/337] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:40 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:40.868502 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9415a1a-c05b-45b3-b09e-92a9da84692e None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:40.868991 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9415a1a-c05b-45b3-b09e-92a9da84692e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:40.869485 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9415a1a-c05b-45b3-b09e-92a9da84692e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:40.910657 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-e9415a1a-c05b-45b3-b09e-92a9da84692e None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:40.912506 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-e9415a1a-c05b-45b3-b09e-92a9da84692e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:41.045819 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:41.055030 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 171/338] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 188 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:41.598355 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e727227-29be-45e9-9213-bb8ebca392c0 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:41.643127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9415a1a-c05b-45b3-b09e-92a9da84692e None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:41.812008 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e727227-29be-45e9-9213-bb8ebca392c0 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:41.874730 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9415a1a-c05b-45b3-b09e-92a9da84692e None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:41.888889 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9657ba-e5d1-4a3a-bb94-daa30475018f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:41.889682 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9657ba-e5d1-4a3a-bb94-daa30475018f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:41.889965 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9657ba-e5d1-4a3a-bb94-daa30475018f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:41.890233 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9657ba-e5d1-4a3a-bb94-daa30475018f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:41.910136 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9657ba-e5d1-4a3a-bb94-daa30475018f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:41.915093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-0b9657ba-e5d1-4a3a-bb94-daa30475018f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:41.915093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:41.915093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:41.915093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:41.915093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:41.915093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:41.915093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:41.915093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:41.915093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:41.915093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:41.915093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:41.915093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:41.915093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:41.915093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:41.915093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:41.915093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:41.917201 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:41.917201 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:41.917201 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:41.917201 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:41.917201 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:41.917201 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:41.917201 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:41.917201 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:41.917201 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:41.917201 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:41.917201 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:41.917201 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:41.917201 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:41.917201 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:41.917201 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:41.917201 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:41.918848 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:41.918848 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:41.918848 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:41.918848 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:41.918848 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:41.918848 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:41.918848 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:41.918848 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:41.918848 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:41.918848 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:41.918848 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:41.918848 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:51:41.918848 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 168/339] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 21 00:51:41 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:41.918848 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52054d6c-d035-4daa-a272-b10a37dd5e76 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:41.921035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52054d6c-d035-4daa-a272-b10a37dd5e76 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:41.921035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52054d6c-d035-4daa-a272-b10a37dd5e76 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:41.921035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 169/340] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:41.926244 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52054d6c-d035-4daa-a272-b10a37dd5e76 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:41.932329 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:41.948471 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34c2995c-cb18-42d9-9774-46b526e8dabd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:41.949258 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2995c-cb18-42d9-9774-46b526e8dabd None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:41.949569 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2995c-cb18-42d9-9774-46b526e8dabd None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:41.949812 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34c2995c-cb18-42d9-9774-46b526e8dabd None admin] PATH_INFO: `/v3/roles/member` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:41.978237 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34c2995c-cb18-42d9-9774-46b526e8dabd None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:41.990264 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-34c2995c-cb18-42d9-9774-46b526e8dabd None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:41.990264 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:41.990264 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:41.990264 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:41.990264 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:41.990264 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:41.990264 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:41.990264 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:41.990264 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:41.990264 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:41.990264 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:41.990264 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:41.990264 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:41.990264 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:41.990264 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:41.990264 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:41.991972 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:41.991972 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:41.991972 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:41.991972 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:41.991972 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:41.991972 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:41.991972 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:41.991972 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:41.991972 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:41.991972 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:41.991972 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:41.991972 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:41.991972 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:41.991972 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:41.991972 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:41.991972 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:41.993484 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:41.993484 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:41.993484 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:41.993484 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:41.993484 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:41.993484 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:41.993484 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:41.993484 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:41.993484 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:41.993484 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:41.993484 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:41.993484 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:41.999444 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 172/341] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:41 2022] GET /identity/v3/roles/member => generated 84 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:51:42.002573 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fb48b-c87c-43e3-a33d-c2a676c25578 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:42.003400 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fb48b-c87c-43e3-a33d-c2a676c25578 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:42.004261 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a80fb48b-c87c-43e3-a33d-c2a676c25578 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:42.063686 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-a80fb48b-c87c-43e3-a33d-c2a676c25578 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:42.068621 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a80fb48b-c87c-43e3-a33d-c2a676c25578 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:42.169789 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52054d6c-d035-4daa-a272-b10a37dd5e76 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:42.202167 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:42.219856 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a488587d-52a1-43c7-b66d-e442d22fedeb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:42.219856 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488587d-52a1-43c7-b66d-e442d22fedeb None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:42.219856 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488587d-52a1-43c7-b66d-e442d22fedeb None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:42.219856 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a488587d-52a1-43c7-b66d-e442d22fedeb None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:42.220495 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488587d-52a1-43c7-b66d-e442d22fedeb None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:42.220495 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488587d-52a1-43c7-b66d-e442d22fedeb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:42.220495 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a488587d-52a1-43c7-b66d-e442d22fedeb None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:42.235666 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 173/342] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:42.237301 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fb48b-c87c-43e3-a33d-c2a676c25578 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:42.241282 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 170/343] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:51:41 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:42.244261 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb9396-93df-434c-b51b-955deb1c5d7f None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:42.244738 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb9396-93df-434c-b51b-955deb1c5d7f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:42.245449 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6aeb9396-93df-434c-b51b-955deb1c5d7f None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:42.248240 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 171/344] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:42.256145 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb9396-93df-434c-b51b-955deb1c5d7f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:42.378978 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:42.490531 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6aeb9396-93df-434c-b51b-955deb1c5d7f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:42.532624 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12c2a698-8353-4ffe-ab55-75c669baad6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:42.533360 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2a698-8353-4ffe-ab55-75c669baad6d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:42.533628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2a698-8353-4ffe-ab55-75c669baad6d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:42.534140 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a80fb48b-c87c-43e3-a33d-c2a676c25578 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:42.534748 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12c2a698-8353-4ffe-ab55-75c669baad6d None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:42.601789 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb1d5532-8298-4a84-b811-192ada198331 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:42.602755 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d5532-8298-4a84-b811-192ada198331 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:42.603235 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d5532-8298-4a84-b811-192ada198331 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:42.603687 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb1d5532-8298-4a84-b811-192ada198331 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:42.605000 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d5532-8298-4a84-b811-192ada198331 None admin] RBAC: Adding query filter params (name=member) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:42.605588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d5532-8298-4a84-b811-192ada198331 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:42.608188 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb1d5532-8298-4a84-b811-192ada198331 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:42.616237 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2a698-8353-4ffe-ab55-75c669baad6d None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:42.617784 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12c2a698-8353-4ffe-ab55-75c669baad6d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:42.627607 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 174/345] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:42 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 391 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:42.629789 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce078df1-740b-4466-b5fb-50d13fb3ec76 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:42.630256 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce078df1-740b-4466-b5fb-50d13fb3ec76 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:42.630774 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce078df1-740b-4466-b5fb-50d13fb3ec76 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:42.664519 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-ce078df1-740b-4466-b5fb-50d13fb3ec76 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:42.666588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-ce078df1-740b-4466-b5fb-50d13fb3ec76 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:42.718176 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:42.761479 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:42.766114 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 172/346] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 517 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:42.768523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318727d-af14-4112-bbf2-c5a8ae868c42 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:42.768669 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318727d-af14-4112-bbf2-c5a8ae868c42 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:42.769026 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f318727d-af14-4112-bbf2-c5a8ae868c42 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:42.775078 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 173/347] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:42 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:42.776385 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318727d-af14-4112-bbf2-c5a8ae868c42 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:42.811131 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 175/348] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:42 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 183 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:42.813813 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce078df1-740b-4466-b5fb-50d13fb3ec76 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:42.936583 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f318727d-af14-4112-bbf2-c5a8ae868c42 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:42.990757 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcff897e-b54c-4981-8b4c-dd75a4398f90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:42.992141 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff897e-b54c-4981-8b4c-dd75a4398f90 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:42.992629 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff897e-b54c-4981-8b4c-dd75a4398f90 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:42.993127 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcff897e-b54c-4981-8b4c-dd75a4398f90 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:43.011412 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce078df1-740b-4466-b5fb-50d13fb3ec76 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:43.056756 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:43.066986 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d00f3ee-9c57-4029-b85d-cb4f486e9094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:43.068097 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00f3ee-9c57-4029-b85d-cb4f486e9094 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:43.068417 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00f3ee-9c57-4029-b85d-cb4f486e9094 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:43.068674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d00f3ee-9c57-4029-b85d-cb4f486e9094 None admin] PATH_INFO: `/v3/roles/reader` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:43.082247 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d00f3ee-9c57-4029-b85d-cb4f486e9094 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:43.088983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-1d00f3ee-9c57-4029-b85d-cb4f486e9094 None admin] Could not find role: reader.: keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:43.088983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:43.088983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:43.088983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:43.088983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:43.088983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:43.088983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:43.088983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:43.088983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:43.088983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:43.088983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:43.088983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:43.088983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:43.088983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:43.088983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:43.088983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:43.090824 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:43.090824 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:43.090824 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:43.090824 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:43.090824 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:43.090824 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:43.090824 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:43.090824 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:43.090824 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:43.090824 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:43.090824 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:43.090824 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:43.090824 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:43.090824 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:43.090824 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:43.090824 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:43.097545 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:43.097545 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:43.097545 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:43.097545 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:43.097545 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:43.097545 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:43.097545 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:43.097545 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:43.097545 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:43.097545 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:43.097545 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: reader. Aug 21 00:51:43.097545 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:43.097545 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 176/349] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:42 2022] GET /identity/v3/roles/reader => generated 84 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:43.097545 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ead47-8599-4ac1-b951-a33e947d2d68 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:43.098850 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ead47-8599-4ac1-b951-a33e947d2d68 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:43.098850 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b35ead47-8599-4ac1-b951-a33e947d2d68 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:43.116027 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-b35ead47-8599-4ac1-b951-a33e947d2d68 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:43.117057 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b35ead47-8599-4ac1-b951-a33e947d2d68 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:43.146751 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff897e-b54c-4981-8b4c-dd75a4398f90 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:43.148230 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcff897e-b54c-4981-8b4c-dd75a4398f90 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:43.192858 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:43.243545 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 177/350] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 153 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:43.249078 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ead47-8599-4ac1-b951-a33e947d2d68 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:43.328993 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 174/351] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:42 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 553 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:43.332887 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323417c-8ad0-49ac-9891-6c730142ab6d None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:43.333425 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323417c-8ad0-49ac-9891-6c730142ab6d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:43.333904 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e323417c-8ad0-49ac-9891-6c730142ab6d None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:43.341212 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 175/352] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:43 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:43.342633 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323417c-8ad0-49ac-9891-6c730142ab6d None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:43.451515 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b35ead47-8599-4ac1-b951-a33e947d2d68 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:43.477762 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:43.519289 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0cf34a8-722d-4426-a93a-1d7f043fcd0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:43.519289 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf34a8-722d-4426-a93a-1d7f043fcd0d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:43.519714 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf34a8-722d-4426-a93a-1d7f043fcd0d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:43.519868 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0cf34a8-722d-4426-a93a-1d7f043fcd0d None admin] PATH_INFO: `/v3/projects/f868b361cbe341f981c4c6441e332398` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:43.521953 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf34a8-722d-4426-a93a-1d7f043fcd0d None admin] RBAC: Authorizing `identity:get_project(project_id=f868b361cbe341f981c4c6441e332398)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:43.524327 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0cf34a8-722d-4426-a93a-1d7f043fcd0d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:43.527881 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 178/353] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:43 2022] GET /identity/v3/projects/f868b361cbe341f981c4c6441e332398 => generated 298 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:43.529966 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471c5c6-560f-4f03-a575-8be50dda33f3 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:43.530428 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471c5c6-560f-4f03-a575-8be50dda33f3 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:43.530871 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9471c5c6-560f-4f03-a575-8be50dda33f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:43.558281 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e323417c-8ad0-49ac-9891-6c730142ab6d None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:43.561963 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-9471c5c6-560f-4f03-a575-8be50dda33f3 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:43.563855 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-9471c5c6-560f-4f03-a575-8be50dda33f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:43.616129 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:43.619350 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1065e-292c-4391-ab1f-0913cc6c835d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:43.620594 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1065e-292c-4391-ab1f-0913cc6c835d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:43.620845 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1065e-292c-4391-ab1f-0913cc6c835d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:43.621283 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88e1065e-292c-4391-ab1f-0913cc6c835d None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:43.622301 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1065e-292c-4391-ab1f-0913cc6c835d None admin] RBAC: Adding query filter params (name=reader) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:43.624834 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1065e-292c-4391-ab1f-0913cc6c835d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:43.625895 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88e1065e-292c-4391-ab1f-0913cc6c835d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:43.642729 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 176/354] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:43 2022] GET /identity/v3/roles?name=reader => generated 341 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:43.644194 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1065e-292c-4391-ab1f-0913cc6c835d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:43.683553 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 179/355] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:43.684936 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471c5c6-560f-4f03-a575-8be50dda33f3 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:43.820123 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88e1065e-292c-4391-ab1f-0913cc6c835d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:43.869448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:43.886261 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a339f-45a4-4335-8dc8-8faa5432943a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:43.888256 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a339f-45a4-4335-8dc8-8faa5432943a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:43.888865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a339f-45a4-4335-8dc8-8faa5432943a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:43.889339 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a77a339f-45a4-4335-8dc8-8faa5432943a None admin] PATH_INFO: `/v3/projects/f868b361cbe341f981c4c6441e332398` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:43.891374 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a339f-45a4-4335-8dc8-8faa5432943a None admin] RBAC: Authorizing `identity:get_project(project_id=f868b361cbe341f981c4c6441e332398)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:43.894088 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a77a339f-45a4-4335-8dc8-8faa5432943a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:43.894709 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9471c5c6-560f-4f03-a575-8be50dda33f3 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:43.897844 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 177/356] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:43 2022] GET /identity/v3/projects/f868b361cbe341f981c4c6441e332398 => generated 298 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:43.899157 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a339f-45a4-4335-8dc8-8faa5432943a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:43.971689 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11fdd6-f05e-4e3b-ade9-37c71e8bdf56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:43.972595 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11fdd6-f05e-4e3b-ade9-37c71e8bdf56 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:43.973031 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11fdd6-f05e-4e3b-ade9-37c71e8bdf56 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:43.973384 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f11fdd6-f05e-4e3b-ade9-37c71e8bdf56 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:43.986883 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f11fdd6-f05e-4e3b-ade9-37c71e8bdf56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:43.991890 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-4f11fdd6-f05e-4e3b-ade9-37c71e8bdf56 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:43.991890 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:43.991890 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:43.991890 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:43.991890 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:43.991890 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:43.991890 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:43.991890 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:43.991890 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:43.991890 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:43.991890 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:43.991890 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:43.991890 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:43.991890 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:43.991890 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:43.991890 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:43.993490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:43.993490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:43.993490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:43.993490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:43.993490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:43.993490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:43.993490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:43.993490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:43.993490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:43.993490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:43.993490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:43.993490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:43.993490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:43.993490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:43.993490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:43.993490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:43.994946 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:43.994946 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:43.994946 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:43.994946 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:43.994946 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:43.994946 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:43.994946 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:43.994946 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:43.994946 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:43.994946 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:43.994946 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:43.994946 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:43.994946 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 180/357] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:43 2022] GET /identity/v3/roles/member => generated 84 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:43.997276 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11fdd6-f05e-4e3b-ade9-37c71e8bdf56 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:44.045592 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:44.089641 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a77a339f-45a4-4335-8dc8-8faa5432943a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:44.153442 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbc9b8-426b-44b9-87c1-42125de63f3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:44.154583 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbc9b8-426b-44b9-87c1-42125de63f3d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:44.155046 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbc9b8-426b-44b9-87c1-42125de63f3d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:44.155490 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2cbc9b8-426b-44b9-87c1-42125de63f3d None admin] PATH_INFO: `/v3/groups/609c4d22b8dd425298928e6207cf82bf` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:44.165937 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cbc9b8-426b-44b9-87c1-42125de63f3d None admin] RBAC: Authorizing `identity:get_group(group_id=609c4d22b8dd425298928e6207cf82bf)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:44.168362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2cbc9b8-426b-44b9-87c1-42125de63f3d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:44.172105 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 178/358] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:43 2022] GET /identity/v3/groups/609c4d22b8dd425298928e6207cf82bf => generated 226 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:44.172467 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbc9b8-426b-44b9-87c1-42125de63f3d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:44.187977 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f11fdd6-f05e-4e3b-ade9-37c71e8bdf56 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:44.261404 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4cb156-febc-4bec-9459-a8a8bcafbbb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:44.262553 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cb156-febc-4bec-9459-a8a8bcafbbb8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:44.263214 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cb156-febc-4bec-9459-a8a8bcafbbb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:44.263793 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4cb156-febc-4bec-9459-a8a8bcafbbb8 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:44.273112 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:44.286383 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4cb156-febc-4bec-9459-a8a8bcafbbb8 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:44.293240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-9f4cb156-febc-4bec-9459-a8a8bcafbbb8 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:44.293240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:44.293240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:44.293240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:44.293240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:44.293240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:44.293240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:44.293240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:44.293240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:44.293240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:44.293240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:44.293240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:44.293240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:44.293240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:44.293240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:44.293240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:44.294564 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:44.294564 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:44.294564 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:44.294564 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:44.294564 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:44.294564 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:44.294564 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:44.294564 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:44.294564 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:44.294564 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:44.294564 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:44.294564 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:44.294564 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:44.294564 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:44.294564 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:44.294564 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:44.296184 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:44.296184 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:44.296184 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:44.296184 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:44.296184 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:44.296184 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:44.296184 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:44.296184 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:44.296184 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:44.296184 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:44.296184 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:44.296184 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:44.296184 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 181/359] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 21 00:51:43 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:44.297596 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4cb156-febc-4bec-9459-a8a8bcafbbb8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:44.350774 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2cbc9b8-426b-44b9-87c1-42125de63f3d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:44.411927 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f9f16-b109-4e7b-8441-83fd444cd10a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:44.413869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f9f16-b109-4e7b-8441-83fd444cd10a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:44.413869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f9f16-b109-4e7b-8441-83fd444cd10a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:44.413869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-050f9f16-b109-4e7b-8441-83fd444cd10a None admin] PATH_INFO: `/v3/users/02b5cc5f43624d5fab124e224984a298` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:44.416218 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f9f16-b109-4e7b-8441-83fd444cd10a None admin] RBAC: Authorizing `identity:get_user(user_id=02b5cc5f43624d5fab124e224984a298)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:44.418193 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-050f9f16-b109-4e7b-8441-83fd444cd10a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:44.420552 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 179/360] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:51:44 2022] GET /identity/v3/users/02b5cc5f43624d5fab124e224984a298 => generated 293 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:44.421847 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f9f16-b109-4e7b-8441-83fd444cd10a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:44.457270 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:44.478927 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4cb156-febc-4bec-9459-a8a8bcafbbb8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:44.546591 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d935093-fa6f-4613-ad5b-cf1b0637da91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:44.547661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d935093-fa6f-4613-ad5b-cf1b0637da91 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:44.548096 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d935093-fa6f-4613-ad5b-cf1b0637da91 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:44.548552 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d935093-fa6f-4613-ad5b-cf1b0637da91 None admin] PATH_INFO: `/v3/groups/609c4d22b8dd425298928e6207cf82bf` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:44.550662 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d935093-fa6f-4613-ad5b-cf1b0637da91 None admin] RBAC: Authorizing `identity:get_group(group_id=609c4d22b8dd425298928e6207cf82bf)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:44.553429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d935093-fa6f-4613-ad5b-cf1b0637da91 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:44.557121 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 182/361] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:44 2022] GET /identity/v3/groups/609c4d22b8dd425298928e6207cf82bf => generated 226 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:44.558087 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d935093-fa6f-4613-ad5b-cf1b0637da91 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:44.601189 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-050f9f16-b109-4e7b-8441-83fd444cd10a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:44.649932 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:44.662995 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee9a90-fbdc-430a-afbd-6c5b34522bf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:44.664966 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee9a90-fbdc-430a-afbd-6c5b34522bf2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:44.664966 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee9a90-fbdc-430a-afbd-6c5b34522bf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:44.664966 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58ee9a90-fbdc-430a-afbd-6c5b34522bf2 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:44.666550 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee9a90-fbdc-430a-afbd-6c5b34522bf2 None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:44.666550 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee9a90-fbdc-430a-afbd-6c5b34522bf2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:44.668307 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58ee9a90-fbdc-430a-afbd-6c5b34522bf2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:44.682319 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 180/362] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:44 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:44.683385 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee9a90-fbdc-430a-afbd-6c5b34522bf2 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:44.733492 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d935093-fa6f-4613-ad5b-cf1b0637da91 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:44.796749 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1bf3b-c652-42ce-a597-243e2fd5747b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:44.797492 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1bf3b-c652-42ce-a597-243e2fd5747b None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:44.797743 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1bf3b-c652-42ce-a597-243e2fd5747b None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:44.798023 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3d1bf3b-c652-42ce-a597-243e2fd5747b None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:44.813601 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3d1bf3b-c652-42ce-a597-243e2fd5747b None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:44.819865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-f3d1bf3b-c652-42ce-a597-243e2fd5747b None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:44.819865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:44.819865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:44.819865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:44.819865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:44.819865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:44.819865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:44.819865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:44.819865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:44.819865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:44.819865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:44.819865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:44.819865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:44.819865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:44.819865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:44.819865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:44.821568 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:44.821568 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:44.821568 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:44.821568 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:44.821568 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:44.821568 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:44.821568 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:44.821568 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:44.821568 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:44.821568 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:44.821568 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:44.821568 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:44.821568 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:44.821568 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:44.821568 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:44.821568 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:44.824039 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:44.824039 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:44.824039 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:44.824039 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:44.824039 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:44.824039 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:44.824039 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:44.824039 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:44.824039 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:44.824039 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:44.824039 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:44.824039 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:44.824039 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 183/363] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:51:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:44.824039 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1bf3b-c652-42ce-a597-243e2fd5747b None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:44.854653 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:44.858741 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58ee9a90-fbdc-430a-afbd-6c5b34522bf2 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:44.920578 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de4c09-0578-4efc-9b78-80b4e27d07c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:44.921359 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de4c09-0578-4efc-9b78-80b4e27d07c1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:44.921776 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de4c09-0578-4efc-9b78-80b4e27d07c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:44.922239 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27de4c09-0578-4efc-9b78-80b4e27d07c1 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:44.923516 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de4c09-0578-4efc-9b78-80b4e27d07c1 None admin] RBAC: Adding query filter params (group.id=609c4d22b8dd425298928e6207cf82bf, role.id=f186b24dc4eb43668f180c85b7c1fc20, scope.project.id=f868b361cbe341f981c4c6441e332398) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:44.923987 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de4c09-0578-4efc-9b78-80b4e27d07c1 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:44.926630 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27de4c09-0578-4efc-9b78-80b4e27d07c1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:44.936261 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 181/364] 10.222.0.49 () {56 vars in 1376 bytes} [Sun Aug 21 00:51:44 2022] GET /identity/v3/role_assignments?group.id=609c4d22b8dd425298928e6207cf82bf&scope.project.id=f868b361cbe341f981c4c6441e332398&role.id=f186b24dc4eb43668f180c85b7c1fc20 => generated 260 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:44.937612 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de4c09-0578-4efc-9b78-80b4e27d07c1 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:45.008564 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3d1bf3b-c652-42ce-a597-243e2fd5747b None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:45.023319 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:45.079244 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85268e40-f0b9-4909-aeb9-ec5c3d654536 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:45.080516 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85268e40-f0b9-4909-aeb9-ec5c3d654536 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:45.080950 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85268e40-f0b9-4909-aeb9-ec5c3d654536 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:45.081459 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85268e40-f0b9-4909-aeb9-ec5c3d654536 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:45.082678 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85268e40-f0b9-4909-aeb9-ec5c3d654536 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:45.083258 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85268e40-f0b9-4909-aeb9-ec5c3d654536 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:45.085827 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85268e40-f0b9-4909-aeb9-ec5c3d654536 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:45.092949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27de4c09-0578-4efc-9b78-80b4e27d07c1 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:45.102734 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 184/365] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:51:44 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:45.104226 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85268e40-f0b9-4909-aeb9-ec5c3d654536 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:45.146295 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89c440-584b-42be-96b9-fc612691532d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:45.147100 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89c440-584b-42be-96b9-fc612691532d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:45.147512 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89c440-584b-42be-96b9-fc612691532d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:45.147916 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d89c440-584b-42be-96b9-fc612691532d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:45.149210 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89c440-584b-42be-96b9-fc612691532d None admin] RBAC: Adding query filter params (role.id=3ad6ad0ef7dd4a94be313f7b1074a82e, user.id=02b5cc5f43624d5fab124e224984a298, scope.system=all) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:45.149669 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89c440-584b-42be-96b9-fc612691532d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:45.151308 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d89c440-584b-42be-96b9-fc612691532d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:45.169676 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 182/366] 10.222.0.49 () {56 vars in 1308 bytes} [Sun Aug 21 00:51:44 2022] GET /identity/v3/role_assignments?user.id=02b5cc5f43624d5fab124e224984a298&scope.system=all&role.id=3ad6ad0ef7dd4a94be313f7b1074a82e => generated 510 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:45.171556 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89c440-584b-42be-96b9-fc612691532d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:45.265474 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:45.317788 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85268e40-f0b9-4909-aeb9-ec5c3d654536 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:45.385156 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070ed42-e014-4172-bf46-2d105f32ab80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:45.385627 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d89c440-584b-42be-96b9-fc612691532d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:45.386938 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070ed42-e014-4172-bf46-2d105f32ab80 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:45.387663 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070ed42-e014-4172-bf46-2d105f32ab80 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:45.388748 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4070ed42-e014-4172-bf46-2d105f32ab80 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:45.391620 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070ed42-e014-4172-bf46-2d105f32ab80 None admin] RBAC: Adding query filter params (group.id=609c4d22b8dd425298928e6207cf82bf, role.id=54545d831b9e469dad64f2d28c12e462, scope.project.id=f868b361cbe341f981c4c6441e332398) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:45.392513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070ed42-e014-4172-bf46-2d105f32ab80 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:45.395386 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4070ed42-e014-4172-bf46-2d105f32ab80 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:45.407589 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:45.408873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 185/367] 10.222.0.49 () {56 vars in 1376 bytes} [Sun Aug 21 00:51:45 2022] GET /identity/v3/role_assignments?group.id=609c4d22b8dd425298928e6207cf82bf&scope.project.id=f868b361cbe341f981c4c6441e332398&role.id=54545d831b9e469dad64f2d28c12e462 => generated 260 bytes in 305 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:45.410145 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070ed42-e014-4172-bf46-2d105f32ab80 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:45.468530 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027f7ca-8830-4846-b105-26916b5a0401 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:45.469007 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027f7ca-8830-4846-b105-26916b5a0401 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:45.470629 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027f7ca-8830-4846-b105-26916b5a0401 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:45.470629 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4027f7ca-8830-4846-b105-26916b5a0401 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:45.651994 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027f7ca-8830-4846-b105-26916b5a0401 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:45.654343 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4027f7ca-8830-4846-b105-26916b5a0401 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:45.663137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4070ed42-e014-4172-bf46-2d105f32ab80 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:45.730637 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ef1c4-94a1-4286-9ce2-fa683ec0cf8c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:45.731717 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ef1c4-94a1-4286-9ce2-fa683ec0cf8c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:45.732028 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ef1c4-94a1-4286-9ce2-fa683ec0cf8c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:45.732542 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d11ef1c4-94a1-4286-9ce2-fa683ec0cf8c None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:45.733906 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ef1c4-94a1-4286-9ce2-fa683ec0cf8c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:45.734458 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ef1c4-94a1-4286-9ce2-fa683ec0cf8c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:45.736677 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d11ef1c4-94a1-4286-9ce2-fa683ec0cf8c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:45.755370 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 186/368] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:45.756967 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ef1c4-94a1-4286-9ce2-fa683ec0cf8c None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:45.764007 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:45.772821 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 183/369] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 602 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:45.774054 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027f7ca-8830-4846-b105-26916b5a0401 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:45.787032 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:45.931454 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4027f7ca-8830-4846-b105-26916b5a0401 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:45.967607 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d11ef1c4-94a1-4286-9ce2-fa683ec0cf8c None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:45.996778 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a78503-b1da-4167-815b-6a9e18f32186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:45.998213 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a78503-b1da-4167-815b-6a9e18f32186 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:45.999317 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a78503-b1da-4167-815b-6a9e18f32186 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:46.000024 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5a78503-b1da-4167-815b-6a9e18f32186 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:46.036045 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5a900-e76f-48db-9d90-ee0c8714881c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:46.037143 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5a900-e76f-48db-9d90-ee0c8714881c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:46.037692 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5a900-e76f-48db-9d90-ee0c8714881c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:46.038178 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9f5a900-e76f-48db-9d90-ee0c8714881c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:46.145180 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a78503-b1da-4167-815b-6a9e18f32186 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:46.148682 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5a78503-b1da-4167-815b-6a9e18f32186 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:46.186406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:46.187581 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5a900-e76f-48db-9d90-ee0c8714881c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:46.190370 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9f5a900-e76f-48db-9d90-ee0c8714881c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:46.195697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:46.376525 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 184/370] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:46.377369 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a78503-b1da-4167-815b-6a9e18f32186 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:46.404219 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 187/371] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:45 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 648 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:46.405947 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5a900-e76f-48db-9d90-ee0c8714881c None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:46.580466 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5a78503-b1da-4167-815b-6a9e18f32186 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:46.600452 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9f5a900-e76f-48db-9d90-ee0c8714881c None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:46.602018 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:46.606635 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:46.645949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba5a54-96d9-4f8c-94df-265c5950a2db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:46.647104 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba5a54-96d9-4f8c-94df-265c5950a2db None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:46.647598 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba5a54-96d9-4f8c-94df-265c5950a2db None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:46.648453 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fba5a54-96d9-4f8c-94df-265c5950a2db None admin] PATH_INFO: `/v3/projects/796ee44386c443e8885ece664a23534b` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:46.650172 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba5a54-96d9-4f8c-94df-265c5950a2db None admin] RBAC: Authorizing `identity:get_project(project_id=796ee44386c443e8885ece664a23534b)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:46.652543 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fba5a54-96d9-4f8c-94df-265c5950a2db None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:46.660885 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 185/372] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:46 2022] GET /identity/v3/projects/796ee44386c443e8885ece664a23534b => generated 302 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:46.660885 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba5a54-96d9-4f8c-94df-265c5950a2db None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:46.676134 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9ad3c-8d1f-4d4a-a4ac-cd1e6c5b10a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:46.677203 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9ad3c-8d1f-4d4a-a4ac-cd1e6c5b10a5 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:46.678287 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9ad3c-8d1f-4d4a-a4ac-cd1e6c5b10a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:46.678793 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aef9ad3c-8d1f-4d4a-a4ac-cd1e6c5b10a5 None admin] PATH_INFO: `/v3/projects/ccef469c265b41be893535a3cf96c82d` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:46.680789 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9ad3c-8d1f-4d4a-a4ac-cd1e6c5b10a5 None admin] RBAC: Authorizing `identity:get_project(project_id=ccef469c265b41be893535a3cf96c82d)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:46.683064 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-aef9ad3c-8d1f-4d4a-a4ac-cd1e6c5b10a5 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:46.686029 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 188/373] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:46 2022] GET /identity/v3/projects/ccef469c265b41be893535a3cf96c82d => generated 344 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:46.687488 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9ad3c-8d1f-4d4a-a4ac-cd1e6c5b10a5 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:46.820712 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fba5a54-96d9-4f8c-94df-265c5950a2db None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:46.840420 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aef9ad3c-8d1f-4d4a-a4ac-cd1e6c5b10a5 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:46.891242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d0b89-be63-4b76-8bf9-fdf7773956ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:46.892273 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d0b89-be63-4b76-8bf9-fdf7773956ac None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:46.892684 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d0b89-be63-4b76-8bf9-fdf7773956ac None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:46.893119 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de0d0b89-be63-4b76-8bf9-fdf7773956ac None admin] PATH_INFO: `/v3/groups/609c4d22b8dd425298928e6207cf82bf` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:46.894938 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d0b89-be63-4b76-8bf9-fdf7773956ac None admin] RBAC: Authorizing `identity:get_group(group_id=609c4d22b8dd425298928e6207cf82bf)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:46.897342 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-de0d0b89-be63-4b76-8bf9-fdf7773956ac None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:46.899114 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 189/374] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:46 2022] GET /identity/v3/groups/609c4d22b8dd425298928e6207cf82bf => generated 226 bytes in 212 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:46.899905 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d0b89-be63-4b76-8bf9-fdf7773956ac None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:46.907099 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6f0f9-fe87-4cc8-94f6-c1fcf425c3de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:46.907755 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6f0f9-fe87-4cc8-94f6-c1fcf425c3de None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:46.908026 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6f0f9-fe87-4cc8-94f6-c1fcf425c3de None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:46.908298 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07e6f0f9-fe87-4cc8-94f6-c1fcf425c3de None admin] PATH_INFO: `/v3/projects/796ee44386c443e8885ece664a23534b` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:46.909518 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e6f0f9-fe87-4cc8-94f6-c1fcf425c3de None admin] RBAC: Authorizing `identity:get_project(project_id=796ee44386c443e8885ece664a23534b)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:46.912906 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07e6f0f9-fe87-4cc8-94f6-c1fcf425c3de None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:46.915512 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 186/375] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:46 2022] GET /identity/v3/projects/796ee44386c443e8885ece664a23534b => generated 302 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:46.916757 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6f0f9-fe87-4cc8-94f6-c1fcf425c3de None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:46.971729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:47.002517 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:47.072565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de0d0b89-be63-4b76-8bf9-fdf7773956ac None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:47.092855 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07e6f0f9-fe87-4cc8-94f6-c1fcf425c3de None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:47.121455 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4ab2b-2c59-4d71-8762-765af19bc73e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:47.122500 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4ab2b-2c59-4d71-8762-765af19bc73e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:47.122841 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4ab2b-2c59-4d71-8762-765af19bc73e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:47.124674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cc4ab2b-2c59-4d71-8762-765af19bc73e None admin] PATH_INFO: `/v3/groups/5f7a4d30d4aa46adaeb53896401a4ff2` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:47.130708 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4ab2b-2c59-4d71-8762-765af19bc73e None admin] RBAC: Authorizing `identity:get_group(group_id=5f7a4d30d4aa46adaeb53896401a4ff2)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:47.138204 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cc4ab2b-2c59-4d71-8762-765af19bc73e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:47.138204 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 190/376] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:46 2022] GET /identity/v3/groups/5f7a4d30d4aa46adaeb53896401a4ff2 => generated 229 bytes in 234 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:47.138204 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4ab2b-2c59-4d71-8762-765af19bc73e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:47.148274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2453ef0d-3baf-4d28-a9ea-eba459d3ed7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:47.149020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453ef0d-3baf-4d28-a9ea-eba459d3ed7b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:47.149462 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453ef0d-3baf-4d28-a9ea-eba459d3ed7b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:47.149867 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2453ef0d-3baf-4d28-a9ea-eba459d3ed7b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:47.150812 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453ef0d-3baf-4d28-a9ea-eba459d3ed7b None admin] RBAC: Adding query filter params (group.id=609c4d22b8dd425298928e6207cf82bf, role.id=54545d831b9e469dad64f2d28c12e462, scope.project.id=796ee44386c443e8885ece664a23534b) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:47.151278 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453ef0d-3baf-4d28-a9ea-eba459d3ed7b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:47.152990 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2453ef0d-3baf-4d28-a9ea-eba459d3ed7b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:47.159867 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 187/377] 10.222.0.49 () {56 vars in 1376 bytes} [Sun Aug 21 00:51:46 2022] GET /identity/v3/role_assignments?group.id=609c4d22b8dd425298928e6207cf82bf&scope.project.id=796ee44386c443e8885ece664a23534b&role.id=54545d831b9e469dad64f2d28c12e462 => generated 260 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:47.161412 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c54c3-0ad2-4172-9ce9-8ea77fe965b9 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:47.161682 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c54c3-0ad2-4172-9ce9-8ea77fe965b9 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:47.161937 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa0c54c3-0ad2-4172-9ce9-8ea77fe965b9 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:47.168650 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 188/378] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:47.169701 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c54c3-0ad2-4172-9ce9-8ea77fe965b9 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:47.352017 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cc4ab2b-2c59-4d71-8762-765af19bc73e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:47.356675 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:47.398892 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7288241c-4409-4053-861c-8156d378930f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:47.398892 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288241c-4409-4053-861c-8156d378930f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:47.399290 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288241c-4409-4053-861c-8156d378930f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:47.399290 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7288241c-4409-4053-861c-8156d378930f None admin] PATH_INFO: `/v3/groups/609c4d22b8dd425298928e6207cf82bf` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:47.400540 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288241c-4409-4053-861c-8156d378930f None admin] RBAC: Authorizing `identity:get_group(group_id=609c4d22b8dd425298928e6207cf82bf)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:47.402686 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7288241c-4409-4053-861c-8156d378930f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:47.404732 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 191/379] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:47 2022] GET /identity/v3/groups/609c4d22b8dd425298928e6207cf82bf => generated 226 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:47.406012 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871cd0d-6754-4137-a3a9-c8dec8cdbc66 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:47.406287 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871cd0d-6754-4137-a3a9-c8dec8cdbc66 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:47.406553 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6871cd0d-6754-4137-a3a9-c8dec8cdbc66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:47.433661 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa0c54c3-0ad2-4172-9ce9-8ea77fe965b9 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:47.436197 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-6871cd0d-6754-4137-a3a9-c8dec8cdbc66 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:47.438539 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-6871cd0d-6754-4137-a3a9-c8dec8cdbc66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:47.446757 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:47.475234 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d831fa-d1ed-418e-95f3-9fc7b681dab4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:47.475914 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d831fa-d1ed-418e-95f3-9fc7b681dab4 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:47.476322 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d831fa-d1ed-418e-95f3-9fc7b681dab4 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:47.476712 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1d831fa-d1ed-418e-95f3-9fc7b681dab4 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:47.477558 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d831fa-d1ed-418e-95f3-9fc7b681dab4 None admin] RBAC: Adding query filter params (group.id=5f7a4d30d4aa46adaeb53896401a4ff2, role.id=c73e9539582145ed8eedc48648b9d738, scope.project.id=ccef469c265b41be893535a3cf96c82d) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:47.477862 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d831fa-d1ed-418e-95f3-9fc7b681dab4 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:47.479600 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1d831fa-d1ed-418e-95f3-9fc7b681dab4 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:47.486493 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 189/380] 10.222.0.49 () {56 vars in 1376 bytes} [Sun Aug 21 00:51:47 2022] GET /identity/v3/role_assignments?group.id=5f7a4d30d4aa46adaeb53896401a4ff2&scope.project.id=ccef469c265b41be893535a3cf96c82d&role.id=c73e9539582145ed8eedc48648b9d738 => generated 260 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:47.487104 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d831fa-d1ed-418e-95f3-9fc7b681dab4 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:47.587345 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 192/381] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 182 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:47.723723 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1d831fa-d1ed-418e-95f3-9fc7b681dab4 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:47.814369 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0eb002-7a96-4ec8-9764-a033354a645a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:47.815484 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0eb002-7a96-4ec8-9764-a033354a645a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:47.815962 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0eb002-7a96-4ec8-9764-a033354a645a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:47.816292 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0eb002-7a96-4ec8-9764-a033354a645a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:47.817704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0eb002-7a96-4ec8-9764-a033354a645a None admin] RBAC: Adding query filter params (group.id=609c4d22b8dd425298928e6207cf82bf, role.id=f186b24dc4eb43668f180c85b7c1fc20, scope.project.id=796ee44386c443e8885ece664a23534b) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:47.818236 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0eb002-7a96-4ec8-9764-a033354a645a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:47.821163 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0eb002-7a96-4ec8-9764-a033354a645a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:47.833624 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fefbe2-38b6-449b-8a3a-c82878249e81 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:47.834114 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fefbe2-38b6-449b-8a3a-c82878249e81 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:47.834588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2fefbe2-38b6-449b-8a3a-c82878249e81 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:47.834775 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 190/382] 10.222.0.49 () {56 vars in 1376 bytes} [Sun Aug 21 00:51:47 2022] GET /identity/v3/role_assignments?group.id=609c4d22b8dd425298928e6207cf82bf&scope.project.id=796ee44386c443e8885ece664a23534b&role.id=f186b24dc4eb43668f180c85b7c1fc20 => generated 260 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:47.840426 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 193/383] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:47.850952 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8540b1f-a3a5-4e7b-a1b6-b9a8bae3aa94 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:47.851231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8540b1f-a3a5-4e7b-a1b6-b9a8bae3aa94 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:47.851500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8540b1f-a3a5-4e7b-a1b6-b9a8bae3aa94 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:47.889148 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-c8540b1f-a3a5-4e7b-a1b6-b9a8bae3aa94 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:47.890674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c8540b1f-a3a5-4e7b-a1b6-b9a8bae3aa94 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:47.942008 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:47.947614 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fefbe2-38b6-449b-8a3a-c82878249e81 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:48.010607 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 191/384] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:48.161855 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2fefbe2-38b6-449b-8a3a-c82878249e81 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:48.163782 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:48.212264 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab471a-33b5-4598-b447-c81622497a5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:48.212921 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab471a-33b5-4598-b447-c81622497a5f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:48.213233 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab471a-33b5-4598-b447-c81622497a5f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:48.213500 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63ab471a-33b5-4598-b447-c81622497a5f None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:48.231534 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63ab471a-33b5-4598-b447-c81622497a5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:48.238025 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-63ab471a-33b5-4598-b447-c81622497a5f None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:48.238025 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:48.238025 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:48.238025 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:48.238025 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:48.238025 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:48.238025 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:48.238025 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:48.238025 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:48.238025 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:48.238025 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:48.238025 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:48.238025 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:48.238025 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:48.238025 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:48.238025 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:48.240139 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:48.240139 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:48.240139 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:48.240139 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:48.240139 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:48.240139 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:48.240139 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:48.240139 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:48.240139 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:48.240139 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:48.240139 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:48.240139 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:48.240139 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:48.240139 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:48.240139 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:48.240139 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:48.241410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:48.241410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:48.241410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:48.241410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:48.241410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:48.241410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:48.241410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:48.241410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:48.241410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:48.241410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:48.241410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:48.241410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:48.241410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 194/385] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 21 00:51:47 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:48.246294 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8540b1f-a3a5-4e7b-a1b6-b9a8bae3aa94 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:48.395861 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8540b1f-a3a5-4e7b-a1b6-b9a8bae3aa94 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:48.453801 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81617a95-56c7-438d-8352-93f11e01e40b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:48.454743 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81617a95-56c7-438d-8352-93f11e01e40b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:48.454743 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81617a95-56c7-438d-8352-93f11e01e40b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:48.455229 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81617a95-56c7-438d-8352-93f11e01e40b None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:48.455612 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81617a95-56c7-438d-8352-93f11e01e40b None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:48.455913 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81617a95-56c7-438d-8352-93f11e01e40b None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:48.457357 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-81617a95-56c7-438d-8352-93f11e01e40b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:48.458090 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab471a-33b5-4598-b447-c81622497a5f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:48.467201 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 192/386] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:51:48 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:48.475016 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81617a95-56c7-438d-8352-93f11e01e40b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:48.539804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:48.652970 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63ab471a-33b5-4598-b447-c81622497a5f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:48.691401 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e611fc-ef7a-4c39-8b26-4fa0f551b82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:48.693802 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e611fc-ef7a-4c39-8b26-4fa0f551b82d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:48.693802 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e611fc-ef7a-4c39-8b26-4fa0f551b82d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:48.693802 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44e611fc-ef7a-4c39-8b26-4fa0f551b82d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:48.700734 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81617a95-56c7-438d-8352-93f11e01e40b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:48.705764 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44e611fc-ef7a-4c39-8b26-4fa0f551b82d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:48.711716 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-44e611fc-ef7a-4c39-8b26-4fa0f551b82d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:48.711716 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:48.711716 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:48.711716 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:48.711716 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:48.711716 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:48.711716 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:48.711716 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:48.711716 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:48.711716 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:48.711716 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:48.711716 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:48.711716 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:48.711716 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:48.711716 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:48.711716 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:48.713489 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:48.713489 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:48.713489 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:48.713489 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:48.713489 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:48.713489 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:48.713489 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:48.713489 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:48.713489 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:48.713489 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:48.713489 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:48.713489 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:48.713489 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:48.713489 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:48.713489 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:48.713489 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:48.715094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:48.715094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:48.715094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:48.715094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:48.715094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:48.715094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:48.715094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:48.715094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:48.715094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:48.715094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:48.715094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:48.715094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:48.717461 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 195/387] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:48 2022] GET /identity/v3/roles/member => generated 84 bytes in 261 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:48.721940 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e611fc-ef7a-4c39-8b26-4fa0f551b82d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:48.752099 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:48.788025 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574000ef-2fa2-453c-b2a9-d9e52dcd666d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:48.788901 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574000ef-2fa2-453c-b2a9-d9e52dcd666d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:48.789066 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574000ef-2fa2-453c-b2a9-d9e52dcd666d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:48.789415 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-574000ef-2fa2-453c-b2a9-d9e52dcd666d None admin] PATH_INFO: `/v3/groups/609c4d22b8dd425298928e6207cf82bf` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:48.790452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574000ef-2fa2-453c-b2a9-d9e52dcd666d None admin] RBAC: Authorizing `identity:get_group(group_id=609c4d22b8dd425298928e6207cf82bf)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:48.791925 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-574000ef-2fa2-453c-b2a9-d9e52dcd666d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:48.793927 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 193/388] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:48 2022] GET /identity/v3/groups/609c4d22b8dd425298928e6207cf82bf => generated 226 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:48.801829 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574000ef-2fa2-453c-b2a9-d9e52dcd666d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:48.841727 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44e611fc-ef7a-4c39-8b26-4fa0f551b82d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:48.881871 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df7f5c-75c0-4ca2-a933-87b12a3e5a41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:48.882503 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df7f5c-75c0-4ca2-a933-87b12a3e5a41 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:48.882823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df7f5c-75c0-4ca2-a933-87b12a3e5a41 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:48.883068 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7df7f5c-75c0-4ca2-a933-87b12a3e5a41 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:48.883714 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df7f5c-75c0-4ca2-a933-87b12a3e5a41 None admin] RBAC: Adding query filter params (name=member) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:48.884014 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df7f5c-75c0-4ca2-a933-87b12a3e5a41 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:48.885487 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b7df7f5c-75c0-4ca2-a933-87b12a3e5a41 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:48.895543 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 196/389] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:48 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:48.901302 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df7f5c-75c0-4ca2-a933-87b12a3e5a41 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:48.995932 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:49.015145 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b7df7f5c-75c0-4ca2-a933-87b12a3e5a41 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:49.060444 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c32e29-59b4-4227-947e-cd3690337688 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:49.061111 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c32e29-59b4-4227-947e-cd3690337688 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:49.061450 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c32e29-59b4-4227-947e-cd3690337688 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:49.061720 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4c32e29-59b4-4227-947e-cd3690337688 None admin] PATH_INFO: `/v3/groups/609c4d22b8dd425298928e6207cf82bf` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:49.064248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c32e29-59b4-4227-947e-cd3690337688 None admin] RBAC: Authorizing `identity:get_group(group_id=609c4d22b8dd425298928e6207cf82bf)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:49.066522 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d4c32e29-59b4-4227-947e-cd3690337688 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:49.068183 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 197/390] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:48 2022] GET /identity/v3/groups/609c4d22b8dd425298928e6207cf82bf => generated 226 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:49.077993 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c32e29-59b4-4227-947e-cd3690337688 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:49.110933 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:49.122518 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-574000ef-2fa2-453c-b2a9-d9e52dcd666d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:49.188834 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af10017-3910-44a3-ad06-d598dcbb600a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:49.189558 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af10017-3910-44a3-ad06-d598dcbb600a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:49.189840 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af10017-3910-44a3-ad06-d598dcbb600a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:49.190071 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af10017-3910-44a3-ad06-d598dcbb600a None admin] PATH_INFO: `/v3/projects/f868b361cbe341f981c4c6441e332398` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:49.193338 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af10017-3910-44a3-ad06-d598dcbb600a None admin] RBAC: Authorizing `identity:get_project(project_id=f868b361cbe341f981c4c6441e332398)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:49.198881 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af10017-3910-44a3-ad06-d598dcbb600a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:49.200716 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 194/391] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:48 2022] GET /identity/v3/projects/f868b361cbe341f981c4c6441e332398 => generated 298 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:49.210027 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af10017-3910-44a3-ad06-d598dcbb600a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:49.226889 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d4c32e29-59b4-4227-947e-cd3690337688 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:49.303060 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1768108-34ff-4a4b-81e5-0b98f836c771 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:49.303661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1768108-34ff-4a4b-81e5-0b98f836c771 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:49.303991 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1768108-34ff-4a4b-81e5-0b98f836c771 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:49.304261 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1768108-34ff-4a4b-81e5-0b98f836c771 None admin] PATH_INFO: `/v3/projects/f868b361cbe341f981c4c6441e332398` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:49.306583 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1768108-34ff-4a4b-81e5-0b98f836c771 None admin] RBAC: Authorizing `identity:get_project(project_id=f868b361cbe341f981c4c6441e332398)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:49.308241 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1768108-34ff-4a4b-81e5-0b98f836c771 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:49.318337 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 198/392] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:49 2022] GET /identity/v3/projects/f868b361cbe341f981c4c6441e332398 => generated 298 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:49.319334 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1768108-34ff-4a4b-81e5-0b98f836c771 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:49.369992 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:49.465392 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1768108-34ff-4a4b-81e5-0b98f836c771 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:49.502556 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af10017-3910-44a3-ad06-d598dcbb600a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:49.505847 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8dfae35-7269-4d05-ac56-551a4d56450f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:49.506601 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfae35-7269-4d05-ac56-551a4d56450f None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:49.506913 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfae35-7269-4d05-ac56-551a4d56450f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:49.507266 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8dfae35-7269-4d05-ac56-551a4d56450f None admin] PATH_INFO: `/v3/projects/f868b361cbe341f981c4c6441e332398/groups/609c4d22b8dd425298928e6207cf82bf/roles/54545d831b9e469dad64f2d28c12e462` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:49.510167 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfae35-7269-4d05-ac56-551a4d56450f None admin] RBAC: Authorizing `identity:create_grant(project_id=f868b361cbe341f981c4c6441e332398, group_id=609c4d22b8dd425298928e6207cf82bf, role_id=54545d831b9e469dad64f2d28c12e462)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:49.511732 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8dfae35-7269-4d05-ac56-551a4d56450f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:49.531467 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 199/393] 10.222.0.49 () {58 vars in 1442 bytes} [Sun Aug 21 00:51:49 2022] PUT /identity/v3/projects/f868b361cbe341f981c4c6441e332398/groups/609c4d22b8dd425298928e6207cf82bf/roles/54545d831b9e469dad64f2d28c12e462 => generated 0 bytes in 212 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:49.608915 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-328d7e01-d06b-4301-bc43-d0b357e1f188 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:49.610086 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d7e01-d06b-4301-bc43-d0b357e1f188 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:49.610568 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d7e01-d06b-4301-bc43-d0b357e1f188 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:49.611055 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-328d7e01-d06b-4301-bc43-d0b357e1f188 None admin] PATH_INFO: `/v3/projects/f868b361cbe341f981c4c6441e332398/groups/609c4d22b8dd425298928e6207cf82bf/roles/f186b24dc4eb43668f180c85b7c1fc20` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:49.615790 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d7e01-d06b-4301-bc43-d0b357e1f188 None admin] RBAC: Authorizing `identity:create_grant(project_id=f868b361cbe341f981c4c6441e332398, group_id=609c4d22b8dd425298928e6207cf82bf, role_id=f186b24dc4eb43668f180c85b7c1fc20)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:49.618865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-328d7e01-d06b-4301-bc43-d0b357e1f188 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:49.648894 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 195/394] 10.222.0.49 () {58 vars in 1442 bytes} [Sun Aug 21 00:51:49 2022] PUT /identity/v3/projects/f868b361cbe341f981c4c6441e332398/groups/609c4d22b8dd425298928e6207cf82bf/roles/f186b24dc4eb43668f180c85b7c1fc20 => generated 0 bytes in 439 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 00:51:49.862066 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25c45b-58ca-4794-bbbf-d1c73c4f89b5 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:49.862573 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25c45b-58ca-4794-bbbf-d1c73c4f89b5 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:49.862846 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a25c45b-58ca-4794-bbbf-d1c73c4f89b5 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:49.864306 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 200/395] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:49.870044 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ed58e-516b-46ee-a58e-39c9f66ba37e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:49.871034 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ed58e-516b-46ee-a58e-39c9f66ba37e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:49.871313 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-284ed58e-516b-46ee-a58e-39c9f66ba37e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:49.895541 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-284ed58e-516b-46ee-a58e-39c9f66ba37e None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:49.897187 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-284ed58e-516b-46ee-a58e-39c9f66ba37e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:49.924783 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:49.990867 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 196/396] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:49 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:50.521373 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25c45b-58ca-4794-bbbf-d1c73c4f89b5 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:50.637006 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:50.660031 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a25c45b-58ca-4794-bbbf-d1c73c4f89b5 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:50.697353 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd05303d-2f70-4985-b0b0-1095b5d6aaf0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:50.698280 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05303d-2f70-4985-b0b0-1095b5d6aaf0 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:50.698678 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05303d-2f70-4985-b0b0-1095b5d6aaf0 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:50.699060 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd05303d-2f70-4985-b0b0-1095b5d6aaf0 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:50.711754 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd05303d-2f70-4985-b0b0-1095b5d6aaf0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:50.716554 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-cd05303d-2f70-4985-b0b0-1095b5d6aaf0 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:50.716554 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:50.716554 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:50.716554 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:50.716554 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:50.716554 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:50.716554 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:50.716554 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:50.716554 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:50.716554 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:50.716554 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:50.716554 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:50.716554 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:50.716554 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:50.716554 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:50.716554 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:50.718642 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:50.718642 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:50.718642 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:50.718642 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:50.718642 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:50.718642 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:50.718642 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:50.718642 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:50.718642 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:50.718642 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:50.718642 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:50.718642 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:50.718642 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:50.718642 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:50.718642 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:50.718642 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:50.720403 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:50.720403 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:50.720403 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:50.720403 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:50.720403 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:50.720403 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:50.720403 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:50.720403 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:50.720403 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:50.720403 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:50.720403 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:50.720403 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:50.720403 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 201/397] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:50 2022] GET /identity/v3/roles/member => generated 84 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:50.731461 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ed58e-516b-46ee-a58e-39c9f66ba37e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:50.894996 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-284ed58e-516b-46ee-a58e-39c9f66ba37e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:50.939513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5cfa4-4e30-4983-ac45-42eb6f5f03fa None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:50.940682 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5cfa4-4e30-4983-ac45-42eb6f5f03fa None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:50.941188 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fec5cfa4-4e30-4983-ac45-42eb6f5f03fa None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:50.943097 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 202/398] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:50.951833 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19efd4-51e4-46a3-905a-582968df9f69 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:50.952759 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba1ae2-8064-4928-b950-c16d00a7b56c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:50.953135 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19efd4-51e4-46a3-905a-582968df9f69 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:50.953424 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba1ae2-8064-4928-b950-c16d00a7b56c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:50.953671 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba1ae2-8064-4928-b950-c16d00a7b56c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:50.953944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceba1ae2-8064-4928-b950-c16d00a7b56c None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:50.954634 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba1ae2-8064-4928-b950-c16d00a7b56c None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:50.954933 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba1ae2-8064-4928-b950-c16d00a7b56c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:50.955224 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf19efd4-51e4-46a3-905a-582968df9f69 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:50.956322 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceba1ae2-8064-4928-b950-c16d00a7b56c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:50.973099 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 197/399] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:50 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:50.975647 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba1ae2-8064-4928-b950-c16d00a7b56c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:50.997415 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-bf19efd4-51e4-46a3-905a-582968df9f69 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:51.000046 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-bf19efd4-51e4-46a3-905a-582968df9f69 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:51.022572 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:51.162958 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 203/400] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:50 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:51.165265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe414c-90fa-40a8-baec-2809d679341c None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:51.165265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe414c-90fa-40a8-baec-2809d679341c None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:51.165265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4cbe414c-90fa-40a8-baec-2809d679341c None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:51.170433 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 204/401] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:51.172127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd074c8-2067-4b4c-ae4b-082047a93bee None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:51.172552 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd074c8-2067-4b4c-ae4b-082047a93bee None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:51.173350 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0dd074c8-2067-4b4c-ae4b-082047a93bee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:51.201306 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-0dd074c8-2067-4b4c-ae4b-082047a93bee None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:51.202925 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-0dd074c8-2067-4b4c-ae4b-082047a93bee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:51.268802 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceba1ae2-8064-4928-b950-c16d00a7b56c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:51.281854 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:51.294212 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 205/402] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:51 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 123 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:51.381145 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e52429-726d-482a-8408-9d8a4af39297 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:51.382618 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e52429-726d-482a-8408-9d8a4af39297 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:51.383315 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e52429-726d-482a-8408-9d8a4af39297 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:51.383995 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7e52429-726d-482a-8408-9d8a4af39297 None admin] PATH_INFO: `/v3/groups/609c4d22b8dd425298928e6207cf82bf` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:51.390284 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e52429-726d-482a-8408-9d8a4af39297 None admin] RBAC: Authorizing `identity:get_group(group_id=609c4d22b8dd425298928e6207cf82bf)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:51.393346 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7e52429-726d-482a-8408-9d8a4af39297 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:51.397068 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 198/403] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:50 2022] GET /identity/v3/groups/609c4d22b8dd425298928e6207cf82bf => generated 226 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:51.405987 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd074c8-2067-4b4c-ae4b-082047a93bee None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:51.517186 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0dd074c8-2067-4b4c-ae4b-082047a93bee None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:51.552824 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c14d1d-210e-4914-928c-ce95519fcf39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:51.553506 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c14d1d-210e-4914-928c-ce95519fcf39 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:51.553784 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c14d1d-210e-4914-928c-ce95519fcf39 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:51.554052 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17c14d1d-210e-4914-928c-ce95519fcf39 None admin] PATH_INFO: `/v3/projects/796ee44386c443e8885ece664a23534b` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:51.555202 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c14d1d-210e-4914-928c-ce95519fcf39 None admin] RBAC: Authorizing `identity:get_project(project_id=796ee44386c443e8885ece664a23534b)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:51.556665 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17c14d1d-210e-4914-928c-ce95519fcf39 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:51.558781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 206/404] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:51 2022] GET /identity/v3/projects/796ee44386c443e8885ece664a23534b => generated 302 bytes in 153 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:51.568770 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e52429-726d-482a-8408-9d8a4af39297 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:51.631428 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c14d1d-210e-4914-928c-ce95519fcf39 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:51.773469 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:51.810544 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:51.845467 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7e52429-726d-482a-8408-9d8a4af39297 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:51.849691 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17c14d1d-210e-4914-928c-ce95519fcf39 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:51.903269 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac532558-4542-4481-ab87-5ffa1bbdf6f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:51.904082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac532558-4542-4481-ab87-5ffa1bbdf6f3 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:51.904215 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac532558-4542-4481-ab87-5ffa1bbdf6f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:51.904464 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac532558-4542-4481-ab87-5ffa1bbdf6f3 None admin] PATH_INFO: `/v3/projects/796ee44386c443e8885ece664a23534b/groups/609c4d22b8dd425298928e6207cf82bf/roles/54545d831b9e469dad64f2d28c12e462` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:51.906782 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac532558-4542-4481-ab87-5ffa1bbdf6f3 None admin] RBAC: Authorizing `identity:create_grant(project_id=796ee44386c443e8885ece664a23534b, group_id=609c4d22b8dd425298928e6207cf82bf, role_id=54545d831b9e469dad64f2d28c12e462)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:51.908416 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac532558-4542-4481-ab87-5ffa1bbdf6f3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:51.927588 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 199/405] 10.222.0.49 () {58 vars in 1442 bytes} [Sun Aug 21 00:51:51 2022] PUT /identity/v3/projects/796ee44386c443e8885ece664a23534b/groups/609c4d22b8dd425298928e6207cf82bf/roles/54545d831b9e469dad64f2d28c12e462 => generated 0 bytes in 360 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:51.929125 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac532558-4542-4481-ab87-5ffa1bbdf6f3 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:51.929455 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9843106-dd05-4930-936b-f8f55a76168f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:51.930532 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9843106-dd05-4930-936b-f8f55a76168f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:51.931103 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9843106-dd05-4930-936b-f8f55a76168f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:51.931550 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9843106-dd05-4930-936b-f8f55a76168f None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:51.978758 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9843106-dd05-4930-936b-f8f55a76168f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:51.998117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-f9843106-dd05-4930-936b-f8f55a76168f None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:51.998117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:51.998117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:51.998117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:51.998117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:51.998117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:51.998117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:51.998117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:51.998117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:51.998117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:51.998117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:51.998117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:51.998117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:51.998117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:51.998117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:51.998117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:52.000334 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:52.000334 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:52.000334 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:52.000334 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:52.000334 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:52.000334 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:52.000334 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:52.000334 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:52.000334 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:52.000334 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:52.000334 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:52.000334 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:52.000334 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:52.000334 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:52.000334 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:52.000334 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:52.002486 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:52.002486 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:52.002486 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:52.002486 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:52.002486 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:52.002486 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:52.002486 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:52.002486 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:52.002486 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:52.002486 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:52.002486 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:52.002486 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:52.015893 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 207/406] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:51:51 2022] GET /identity/v3/roles/admin => generated 83 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:52.025649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9843106-dd05-4930-936b-f8f55a76168f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:52.075957 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac532558-4542-4481-ab87-5ffa1bbdf6f3 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:52.154428 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0ab21-5647-41e9-9b78-275b3aa336d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:52.155931 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0ab21-5647-41e9-9b78-275b3aa336d5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:52.156614 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0ab21-5647-41e9-9b78-275b3aa336d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:52.157297 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fd0ab21-5647-41e9-9b78-275b3aa336d5 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:52.174769 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fd0ab21-5647-41e9-9b78-275b3aa336d5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:52.175097 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9843106-dd05-4930-936b-f8f55a76168f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:52.185897 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-3fd0ab21-5647-41e9-9b78-275b3aa336d5 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:52.185897 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:52.185897 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:52.185897 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:52.185897 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:52.185897 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:52.185897 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:52.185897 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:52.185897 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:52.185897 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:52.185897 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:52.185897 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:52.185897 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:52.185897 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:52.185897 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:52.185897 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:52.188048 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:52.188048 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:52.188048 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:52.188048 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:52.188048 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:52.188048 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:52.188048 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:52.188048 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:52.188048 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:52.188048 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:52.188048 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:52.188048 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:52.188048 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:52.188048 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:52.188048 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:52.188048 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:52.189903 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:52.189903 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:52.189903 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:52.189903 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:52.189903 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:52.189903 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:52.189903 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:52.189903 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:52.189903 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:52.189903 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:52.189903 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:52.189903 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:51:52.193954 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 200/407] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 21 00:51:51 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:52.203719 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0ab21-5647-41e9-9b78-275b3aa336d5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:52.246482 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:52.247445 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:52.259511 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1390916-8b2b-4acf-8202-ee84df9e38ab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:52.260130 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1390916-8b2b-4acf-8202-ee84df9e38ab None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:52.260405 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1390916-8b2b-4acf-8202-ee84df9e38ab None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:52.260680 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1390916-8b2b-4acf-8202-ee84df9e38ab None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:52.261509 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1390916-8b2b-4acf-8202-ee84df9e38ab None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:52.261809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1390916-8b2b-4acf-8202-ee84df9e38ab None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:52.263247 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1390916-8b2b-4acf-8202-ee84df9e38ab None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:52.276849 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 208/408] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:52 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:52.278289 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e240b-bfa3-4e5b-9f53-ce08088e6a7a None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:52.278877 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e240b-bfa3-4e5b-9f53-ce08088e6a7a None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:52.279157 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346e240b-bfa3-4e5b-9f53-ce08088e6a7a None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:52.280786 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 209/409] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:52.287956 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8362122-2caf-405b-bc90-b1380437b674 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:52.288348 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8362122-2caf-405b-bc90-b1380437b674 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:52.288521 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8362122-2caf-405b-bc90-b1380437b674 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:52.309079 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-a8362122-2caf-405b-bc90-b1380437b674 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:52.310329 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a8362122-2caf-405b-bc90-b1380437b674 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:52.386162 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fd0ab21-5647-41e9-9b78-275b3aa336d5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:52.393596 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 210/410] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 108 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:52.395849 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72c905-d18b-4291-a013-832f0988c645 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:52.396340 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72c905-d18b-4291-a013-832f0988c645 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:52.396817 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a72c905-d18b-4291-a013-832f0988c645 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:52.401241 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 211/411] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:52 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:52.402243 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72c905-d18b-4291-a013-832f0988c645 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:52.437097 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b3218b-8b2e-446b-96f8-20d2e92e7e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:52.437761 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3218b-8b2e-446b-96f8-20d2e92e7e82 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:52.438033 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3218b-8b2e-446b-96f8-20d2e92e7e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:52.438297 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b3218b-8b2e-446b-96f8-20d2e92e7e82 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:52.439129 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3218b-8b2e-446b-96f8-20d2e92e7e82 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:52.439481 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3218b-8b2e-446b-96f8-20d2e92e7e82 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:52.440900 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b3218b-8b2e-446b-96f8-20d2e92e7e82 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:52.450797 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 201/412] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:51:52 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:52.452192 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde88d6-8f93-4de0-87e7-0085654a5bd8 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:52.452476 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde88d6-8f93-4de0-87e7-0085654a5bd8 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:52.452743 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4dde88d6-8f93-4de0-87e7-0085654a5bd8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:52.472702 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-4dde88d6-8f93-4de0-87e7-0085654a5bd8 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:52.474068 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4dde88d6-8f93-4de0-87e7-0085654a5bd8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:52.549987 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:52.557813 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 202/413] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:52 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:52.559053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde88d6-8f93-4de0-87e7-0085654a5bd8 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:52.660171 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a72c905-d18b-4291-a013-832f0988c645 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:52.676426 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4dde88d6-8f93-4de0-87e7-0085654a5bd8 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:52.700201 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:52.713782 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f679744-d214-476d-8830-5a54f1dc2505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:52.714672 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f679744-d214-476d-8830-5a54f1dc2505 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:52.715047 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f679744-d214-476d-8830-5a54f1dc2505 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:52.715418 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f679744-d214-476d-8830-5a54f1dc2505 None admin] PATH_INFO: `/v3/groups/5f7a4d30d4aa46adaeb53896401a4ff2` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:52.716193 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a4a8d-90b2-4315-a7bf-634623147ae1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:52.716995 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a4a8d-90b2-4315-a7bf-634623147ae1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:52.717244 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f679744-d214-476d-8830-5a54f1dc2505 None admin] RBAC: Authorizing `identity:get_group(group_id=5f7a4d30d4aa46adaeb53896401a4ff2)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:52.717637 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a4a8d-90b2-4315-a7bf-634623147ae1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:52.718039 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a9a4a8d-90b2-4315-a7bf-634623147ae1 None admin] PATH_INFO: `/v3/groups/609c4d22b8dd425298928e6207cf82bf` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:52.719077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f679744-d214-476d-8830-5a54f1dc2505 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:52.719654 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a4a8d-90b2-4315-a7bf-634623147ae1 None admin] RBAC: Authorizing `identity:get_group(group_id=609c4d22b8dd425298928e6207cf82bf)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:52.721257 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a9a4a8d-90b2-4315-a7bf-634623147ae1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:52.721400 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 212/414] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:52 2022] GET /identity/v3/groups/5f7a4d30d4aa46adaeb53896401a4ff2 => generated 229 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:52.726781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f679744-d214-476d-8830-5a54f1dc2505 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:52.728184 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 203/415] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:52 2022] GET /identity/v3/groups/609c4d22b8dd425298928e6207cf82bf => generated 226 bytes in 169 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:52.729248 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a4a8d-90b2-4315-a7bf-634623147ae1 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:52.807308 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:52.862864 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a9a4a8d-90b2-4315-a7bf-634623147ae1 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:52.906824 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97557b64-c967-4d1b-bc5c-4da64b1427b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:52.908187 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97557b64-c967-4d1b-bc5c-4da64b1427b6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:52.908628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97557b64-c967-4d1b-bc5c-4da64b1427b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:52.909032 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97557b64-c967-4d1b-bc5c-4da64b1427b6 None admin] PATH_INFO: `/v3/projects/ccef469c265b41be893535a3cf96c82d` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:52.909184 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f679744-d214-476d-8830-5a54f1dc2505 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:52.910570 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97557b64-c967-4d1b-bc5c-4da64b1427b6 None admin] RBAC: Authorizing `identity:get_project(project_id=ccef469c265b41be893535a3cf96c82d)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:52.912194 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97557b64-c967-4d1b-bc5c-4da64b1427b6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:52.918968 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 204/416] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:52 2022] GET /identity/v3/projects/ccef469c265b41be893535a3cf96c82d => generated 344 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:52.920440 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97557b64-c967-4d1b-bc5c-4da64b1427b6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:52.960218 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb994a-1fc2-4944-b0a3-c334b0904ce2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:52.961225 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb994a-1fc2-4944-b0a3-c334b0904ce2 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:52.961508 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb994a-1fc2-4944-b0a3-c334b0904ce2 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:52.961782 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9dbb994a-1fc2-4944-b0a3-c334b0904ce2 None admin] PATH_INFO: `/v3/roles/member` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:52.982156 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9dbb994a-1fc2-4944-b0a3-c334b0904ce2 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:52.991886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-9dbb994a-1fc2-4944-b0a3-c334b0904ce2 None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:52.991886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:52.991886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:52.991886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:52.991886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:52.991886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:52.991886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:52.991886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:52.991886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:52.991886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:52.991886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:52.991886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:52.991886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:52.991886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:52.991886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:52.991886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:52.992941 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:52.992941 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:52.992941 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:52.992941 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:52.992941 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:52.992941 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:52.992941 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:52.992941 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:52.992941 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:52.992941 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:52.992941 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:52.992941 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:52.992941 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:52.992941 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:52.992941 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:52.992941 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:52.993962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:52.993962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:52.993962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:52.993962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:52.993962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:52.993962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:52.993962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:52.993962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:52.993962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:52.993962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:52.993962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:52.993962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:52.993962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 213/417] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:52 2022] GET /identity/v3/roles/member => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:52.995029 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb994a-1fc2-4944-b0a3-c334b0904ce2 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:53.047724 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97557b64-c967-4d1b-bc5c-4da64b1427b6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:53.069181 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:53.095789 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154d9e8-e615-4ecf-8f6c-9f6e34960f74 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:53.096454 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154d9e8-e615-4ecf-8f6c-9f6e34960f74 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:53.096737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154d9e8-e615-4ecf-8f6c-9f6e34960f74 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:53.097013 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6154d9e8-e615-4ecf-8f6c-9f6e34960f74 None admin] PATH_INFO: `/v3/projects/796ee44386c443e8885ece664a23534b` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:53.098585 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6154d9e8-e615-4ecf-8f6c-9f6e34960f74 None admin] RBAC: Authorizing `identity:get_project(project_id=796ee44386c443e8885ece664a23534b)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:53.101201 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6154d9e8-e615-4ecf-8f6c-9f6e34960f74 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:53.108657 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 205/418] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:52 2022] GET /identity/v3/projects/796ee44386c443e8885ece664a23534b => generated 302 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:53.109842 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154d9e8-e615-4ecf-8f6c-9f6e34960f74 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:53.113974 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:53.140218 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9dbb994a-1fc2-4944-b0a3-c334b0904ce2 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:53.196555 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990ffb0-66b9-44e0-854b-0eb57e7860f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:53.197486 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990ffb0-66b9-44e0-854b-0eb57e7860f0 None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:53.197935 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990ffb0-66b9-44e0-854b-0eb57e7860f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:53.198390 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1990ffb0-66b9-44e0-854b-0eb57e7860f0 None admin] PATH_INFO: `/v3/projects/ccef469c265b41be893535a3cf96c82d/groups/5f7a4d30d4aa46adaeb53896401a4ff2/roles/c73e9539582145ed8eedc48648b9d738` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:53.201332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990ffb0-66b9-44e0-854b-0eb57e7860f0 None admin] RBAC: Authorizing `identity:create_grant(project_id=ccef469c265b41be893535a3cf96c82d, group_id=5f7a4d30d4aa46adaeb53896401a4ff2, role_id=c73e9539582145ed8eedc48648b9d738)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:53.203507 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1990ffb0-66b9-44e0-854b-0eb57e7860f0 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:53.230933 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 214/419] 10.222.0.49 () {58 vars in 1442 bytes} [Sun Aug 21 00:51:52 2022] PUT /identity/v3/projects/ccef469c265b41be893535a3cf96c82d/groups/5f7a4d30d4aa46adaeb53896401a4ff2/roles/c73e9539582145ed8eedc48648b9d738 => generated 0 bytes in 236 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:53.232681 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990ffb0-66b9-44e0-854b-0eb57e7860f0 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:53.251679 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6154d9e8-e615-4ecf-8f6c-9f6e34960f74 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:53.291908 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd09d5c-7595-461f-841a-893bcc43d2cc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:53.292946 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd09d5c-7595-461f-841a-893bcc43d2cc None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:53.293594 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd09d5c-7595-461f-841a-893bcc43d2cc None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:53.293997 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd09d5c-7595-461f-841a-893bcc43d2cc None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:53.295065 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd09d5c-7595-461f-841a-893bcc43d2cc None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:53.295567 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd09d5c-7595-461f-841a-893bcc43d2cc None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:53.298267 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd09d5c-7595-461f-841a-893bcc43d2cc None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:53.314017 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 206/420] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:53 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 205 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:53.315510 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd09d5c-7595-461f-841a-893bcc43d2cc None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:53.403926 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1990ffb0-66b9-44e0-854b-0eb57e7860f0 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:53.414292 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:53.422054 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:53.461955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd09d5c-7595-461f-841a-893bcc43d2cc None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:53.474152 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19692691-13ad-4ce9-a6e9-8c2e19ef602a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:53.475164 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19692691-13ad-4ce9-a6e9-8c2e19ef602a None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:53.475578 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19692691-13ad-4ce9-a6e9-8c2e19ef602a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:53.476024 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19692691-13ad-4ce9-a6e9-8c2e19ef602a None admin] PATH_INFO: `/v3/projects/796ee44386c443e8885ece664a23534b/groups/609c4d22b8dd425298928e6207cf82bf/roles/f186b24dc4eb43668f180c85b7c1fc20` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:53.480418 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19692691-13ad-4ce9-a6e9-8c2e19ef602a None admin] RBAC: Authorizing `identity:create_grant(project_id=796ee44386c443e8885ece664a23534b, group_id=609c4d22b8dd425298928e6207cf82bf, role_id=f186b24dc4eb43668f180c85b7c1fc20)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:53.482954 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-19692691-13ad-4ce9-a6e9-8c2e19ef602a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:53.505629 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 215/421] 10.222.0.49 () {58 vars in 1442 bytes} [Sun Aug 21 00:51:53 2022] PUT /identity/v3/projects/796ee44386c443e8885ece664a23534b/groups/609c4d22b8dd425298928e6207cf82bf/roles/f186b24dc4eb43668f180c85b7c1fc20 => generated 0 bytes in 274 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:51:53.506838 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19692691-13ad-4ce9-a6e9-8c2e19ef602a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:53.521291 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d9fbe-4aa1-4399-823b-a7a7e71e8510 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:53.522178 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d9fbe-4aa1-4399-823b-a7a7e71e8510 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:53.522491 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d9fbe-4aa1-4399-823b-a7a7e71e8510 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:53.522848 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-104d9fbe-4aa1-4399-823b-a7a7e71e8510 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:53.539881 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-104d9fbe-4aa1-4399-823b-a7a7e71e8510 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:53.546846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-104d9fbe-4aa1-4399-823b-a7a7e71e8510 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:53.546846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:53.546846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:53.546846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:53.546846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:53.546846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:53.546846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:53.546846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:53.546846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:53.546846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:53.546846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:53.546846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:53.546846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:53.546846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:53.546846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:53.546846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:53.548515 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:53.548515 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:53.548515 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:53.548515 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:53.548515 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:53.548515 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:53.548515 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:53.548515 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:53.548515 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:53.548515 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:53.548515 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:53.548515 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:53.548515 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:53.548515 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:53.548515 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:53.548515 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:53.550197 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:53.550197 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:53.550197 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:53.550197 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:53.550197 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:53.550197 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:53.550197 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:53.550197 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:53.550197 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:53.550197 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:53.550197 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:53.550197 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:51:53.550197 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 207/422] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 21 00:51:53 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:53.555061 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d9fbe-4aa1-4399-823b-a7a7e71e8510 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:53.683580 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-104d9fbe-4aa1-4399-823b-a7a7e71e8510 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:53.709868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:53.712009 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19692691-13ad-4ce9-a6e9-8c2e19ef602a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:53.722401 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805af622-ad03-47d5-89d6-08bd0244b1db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:53.723050 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805af622-ad03-47d5-89d6-08bd0244b1db None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:53.723322 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805af622-ad03-47d5-89d6-08bd0244b1db None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:53.723585 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-805af622-ad03-47d5-89d6-08bd0244b1db None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:53.724283 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805af622-ad03-47d5-89d6-08bd0244b1db None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:53.724585 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805af622-ad03-47d5-89d6-08bd0244b1db None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:53.726083 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-805af622-ad03-47d5-89d6-08bd0244b1db None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:53.735756 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 208/423] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:51:53 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:53.741562 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805af622-ad03-47d5-89d6-08bd0244b1db None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:53.784848 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae811478-d162-4f31-9a6e-301a3cec3b2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:53.785924 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae811478-d162-4f31-9a6e-301a3cec3b2e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:53.786469 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae811478-d162-4f31-9a6e-301a3cec3b2e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:53.787145 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae811478-d162-4f31-9a6e-301a3cec3b2e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:53.845213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:53.902032 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae811478-d162-4f31-9a6e-301a3cec3b2e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:53.903550 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae811478-d162-4f31-9a6e-301a3cec3b2e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:53.911425 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-805af622-ad03-47d5-89d6-08bd0244b1db None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:54.034469 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f752b6-a9c2-4f0e-b721-13d23579c1f3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:54.035107 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f752b6-a9c2-4f0e-b721-13d23579c1f3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:54.035385 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f752b6-a9c2-4f0e-b721-13d23579c1f3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:54.035656 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6f752b6-a9c2-4f0e-b721-13d23579c1f3 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:54.042417 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 216/424] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 536 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:54.049769 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae811478-d162-4f31-9a6e-301a3cec3b2e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:54.161983 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:54.191485 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:54.192851 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f752b6-a9c2-4f0e-b721-13d23579c1f3 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:54.194569 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6f752b6-a9c2-4f0e-b721-13d23579c1f3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:54.287690 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae811478-d162-4f31-9a6e-301a3cec3b2e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:54.378427 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 209/425] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:53 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 637 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 21 00:51:54.380452 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2ab5c-6345-4c16-bc9f-7844a51c7543 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:54.381582 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2ab5c-6345-4c16-bc9f-7844a51c7543 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:54.382056 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2ab5c-6345-4c16-bc9f-7844a51c7543 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:54.382528 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cad2ab5c-6345-4c16-bc9f-7844a51c7543 None admin] PATH_INFO: `/v3/projects/f868b361cbe341f981c4c6441e332398` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:54.384543 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f752b6-a9c2-4f0e-b721-13d23579c1f3 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:54.400761 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2ab5c-6345-4c16-bc9f-7844a51c7543 None admin] RBAC: Authorizing `identity:get_project(project_id=f868b361cbe341f981c4c6441e332398)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:54.403531 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cad2ab5c-6345-4c16-bc9f-7844a51c7543 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:54.410682 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 217/426] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:54 2022] GET /identity/v3/projects/f868b361cbe341f981c4c6441e332398 => generated 298 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:54.415952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2ab5c-6345-4c16-bc9f-7844a51c7543 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:54.654168 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cad2ab5c-6345-4c16-bc9f-7844a51c7543 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:54.701469 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:54.738634 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d63eccd3-2f5a-4aaf-b910-8a8af1459b0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:54.739285 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63eccd3-2f5a-4aaf-b910-8a8af1459b0c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:54.739467 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6f752b6-a9c2-4f0e-b721-13d23579c1f3 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:54.739614 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63eccd3-2f5a-4aaf-b910-8a8af1459b0c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:54.739891 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d63eccd3-2f5a-4aaf-b910-8a8af1459b0c None admin] PATH_INFO: `/v3/groups/609c4d22b8dd425298928e6207cf82bf` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:54.741120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63eccd3-2f5a-4aaf-b910-8a8af1459b0c None admin] RBAC: Authorizing `identity:get_group(group_id=609c4d22b8dd425298928e6207cf82bf)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:54.742728 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d63eccd3-2f5a-4aaf-b910-8a8af1459b0c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:54.744826 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 218/427] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:54 2022] GET /identity/v3/groups/609c4d22b8dd425298928e6207cf82bf => generated 226 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:54.746217 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7641f6-88bb-443d-8204-acf414d80003 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:54.746497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7641f6-88bb-443d-8204-acf414d80003 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:54.746809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c7641f6-88bb-443d-8204-acf414d80003 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:54.752893 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 219/428] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:51:54.754020 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7641f6-88bb-443d-8204-acf414d80003 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:54.758553 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:54.813893 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc80949a-2774-4573-92b6-1b61a4e14e3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:54.814804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80949a-2774-4573-92b6-1b61a4e14e3b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:54.815507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80949a-2774-4573-92b6-1b61a4e14e3b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:54.815910 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc80949a-2774-4573-92b6-1b61a4e14e3b None admin] PATH_INFO: `/v3/projects/f868b361cbe341f981c4c6441e332398` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:54.818655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80949a-2774-4573-92b6-1b61a4e14e3b None admin] RBAC: Authorizing `identity:get_project(project_id=f868b361cbe341f981c4c6441e332398)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:54.821838 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc80949a-2774-4573-92b6-1b61a4e14e3b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:54.829076 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 210/429] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:54 2022] GET /identity/v3/projects/f868b361cbe341f981c4c6441e332398 => generated 298 bytes in 442 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:54.829076 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fff38e-5f18-436c-895f-e25687f29617 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:54.829076 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fff38e-5f18-436c-895f-e25687f29617 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:54.829076 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7fff38e-5f18-436c-895f-e25687f29617 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:54.865949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e7fff38e-5f18-436c-895f-e25687f29617 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:54.867337 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e7fff38e-5f18-436c-895f-e25687f29617 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:54.903487 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c7641f6-88bb-443d-8204-acf414d80003 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:54.971962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db45da-565b-49e9-a26d-114293a089c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:54.974283 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db45da-565b-49e9-a26d-114293a089c9 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:54.975301 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db45da-565b-49e9-a26d-114293a089c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:54.976043 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16db45da-565b-49e9-a26d-114293a089c9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:54.977990 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db45da-565b-49e9-a26d-114293a089c9 None admin] RBAC: Adding query filter params (group.id=609c4d22b8dd425298928e6207cf82bf, role.id=54545d831b9e469dad64f2d28c12e462, scope.project.id=f868b361cbe341f981c4c6441e332398) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:54.978949 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db45da-565b-49e9-a26d-114293a089c9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:54.982287 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16db45da-565b-49e9-a26d-114293a089c9 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:54.994360 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 220/430] 10.222.0.49 () {56 vars in 1376 bytes} [Sun Aug 21 00:51:54 2022] GET /identity/v3/role_assignments?group.id=609c4d22b8dd425298928e6207cf82bf&scope.project.id=f868b361cbe341f981c4c6441e332398&role.id=54545d831b9e469dad64f2d28c12e462 => generated 611 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:54.996363 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db45da-565b-49e9-a26d-114293a089c9 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:55.001341 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 211/431] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:54 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:51:55.153080 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:55.221523 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16db45da-565b-49e9-a26d-114293a089c9 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:55.306953 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59a7d1-d36e-4c4e-b507-30bca24e7b35 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:55.307559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59a7d1-d36e-4c4e-b507-30bca24e7b35 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:55.307911 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59a7d1-d36e-4c4e-b507-30bca24e7b35 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:55.308193 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d59a7d1-d36e-4c4e-b507-30bca24e7b35 None admin] PATH_INFO: `/v3/groups/609c4d22b8dd425298928e6207cf82bf` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:55.309542 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59a7d1-d36e-4c4e-b507-30bca24e7b35 None admin] RBAC: Authorizing `identity:get_group(group_id=609c4d22b8dd425298928e6207cf82bf)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:55.311142 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d59a7d1-d36e-4c4e-b507-30bca24e7b35 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:55.313475 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 221/432] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:54 2022] GET /identity/v3/groups/609c4d22b8dd425298928e6207cf82bf => generated 226 bytes in 318 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:55.321846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fff38e-5f18-436c-895f-e25687f29617 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:55.438264 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:55.459822 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7fff38e-5f18-436c-895f-e25687f29617 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:55.501034 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59a7d1-d36e-4c4e-b507-30bca24e7b35 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:55.503689 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9743bde-6be1-4d67-ab3b-2b9da0c891ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:55.504331 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9743bde-6be1-4d67-ab3b-2b9da0c891ee None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:55.504613 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9743bde-6be1-4d67-ab3b-2b9da0c891ee None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:55.504882 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9743bde-6be1-4d67-ab3b-2b9da0c891ee None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:55.505678 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9743bde-6be1-4d67-ab3b-2b9da0c891ee None admin] RBAC: Adding query filter params (group.id=609c4d22b8dd425298928e6207cf82bf, role.id=f186b24dc4eb43668f180c85b7c1fc20, scope.project.id=f868b361cbe341f981c4c6441e332398) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:55.505985 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9743bde-6be1-4d67-ab3b-2b9da0c891ee None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:55.507496 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9743bde-6be1-4d67-ab3b-2b9da0c891ee None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:55.514747 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 212/433] 10.222.0.49 () {56 vars in 1376 bytes} [Sun Aug 21 00:51:55 2022] GET /identity/v3/role_assignments?group.id=609c4d22b8dd425298928e6207cf82bf&scope.project.id=f868b361cbe341f981c4c6441e332398&role.id=f186b24dc4eb43668f180c85b7c1fc20 => generated 611 bytes in 193 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:55.641992 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d59a7d1-d36e-4c4e-b507-30bca24e7b35 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:55.683517 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc0bb9-66d6-4c9f-92a4-940dedc5b82d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:55.684409 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc0bb9-66d6-4c9f-92a4-940dedc5b82d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:55.684820 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc0bb9-66d6-4c9f-92a4-940dedc5b82d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:55.685272 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9edc0bb9-66d6-4c9f-92a4-940dedc5b82d None admin] PATH_INFO: `/v3/roles/member` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:55.688617 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:55.699614 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9edc0bb9-66d6-4c9f-92a4-940dedc5b82d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:55.709180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-9edc0bb9-66d6-4c9f-92a4-940dedc5b82d None admin] Could not find role: member.: keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:55.709180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:55.709180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:55.709180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:55.709180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:55.709180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:55.709180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:55.709180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:55.709180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:55.709180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:55.709180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:55.709180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:55.709180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:55.709180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:55.709180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:55.709180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:55.710994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:55.710994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:55.710994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:55.710994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:55.710994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:55.710994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:55.710994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:55.710994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:55.710994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:55.710994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:55.710994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:55.710994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:55.710994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:55.710994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:55.710994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:55.710994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:55.712082 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:55.712082 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:55.712082 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:55.712082 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:55.712082 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:55.712082 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:55.712082 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:55.712082 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:55.712082 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:55.712082 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:55.712082 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: member. Aug 21 00:51:55.712082 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:55.714624 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 222/434] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:55 2022] GET /identity/v3/roles/member => generated 84 bytes in 215 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:55.720822 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9743bde-6be1-4d67-ab3b-2b9da0c891ee None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:55.854310 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9743bde-6be1-4d67-ab3b-2b9da0c891ee None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:55.894706 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6590c1-0867-41f2-8777-4cc4607b660f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:55.895559 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6590c1-0867-41f2-8777-4cc4607b660f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:55.896021 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6590c1-0867-41f2-8777-4cc4607b660f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:55.896444 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6590c1-0867-41f2-8777-4cc4607b660f None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:55.897312 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6590c1-0867-41f2-8777-4cc4607b660f None admin] RBAC: Adding query filter params (name=member) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:55.897759 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6590c1-0867-41f2-8777-4cc4607b660f None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:55.899381 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6590c1-0867-41f2-8777-4cc4607b660f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:55.911594 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 213/435] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:51:55 2022] GET /identity/v3/roles?name=member => generated 341 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:55.917834 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc0bb9-66d6-4c9f-92a4-940dedc5b82d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:56.040934 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9edc0bb9-66d6-4c9f-92a4-940dedc5b82d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:56.081305 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acd44ee8-bc78-415a-9c34-b63204a19517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:56.082180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd44ee8-bc78-415a-9c34-b63204a19517 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:56.082593 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd44ee8-bc78-415a-9c34-b63204a19517 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:56.083027 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acd44ee8-bc78-415a-9c34-b63204a19517 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:56.159268 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:56.168900 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd44ee8-bc78-415a-9c34-b63204a19517 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:56.170532 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acd44ee8-bc78-415a-9c34-b63204a19517 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:56.170694 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a862538-a879-4537-95ac-2b09abf53023 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:56.171300 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a862538-a879-4537-95ac-2b09abf53023 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:56.171300 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a862538-a879-4537-95ac-2b09abf53023 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:56.172955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 214/436] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:51:56.178728 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f4955-584c-41c4-bd0e-de183960a820 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:56.179022 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f4955-584c-41c4-bd0e-de183960a820 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:56.179273 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0c3f4955-584c-41c4-bd0e-de183960a820 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:56.200206 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-0c3f4955-584c-41c4-bd0e-de183960a820 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:56.201487 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0c3f4955-584c-41c4-bd0e-de183960a820 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:56.206137 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:56.333832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 215/437] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:56.367877 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 223/438] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:55 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 450 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:56.377436 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f4955-584c-41c4-bd0e-de183960a820 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:56.387161 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56733d72-b0d6-43be-9d81-8f0b6a706ba8 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:56.387451 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56733d72-b0d6-43be-9d81-8f0b6a706ba8 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:56.387730 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56733d72-b0d6-43be-9d81-8f0b6a706ba8 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:56.393187 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 224/439] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:51:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:51:56.395355 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b22b4-133c-42bf-9e7e-80edb092695f None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:56.395642 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b22b4-133c-42bf-9e7e-80edb092695f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:56.395922 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-953b22b4-133c-42bf-9e7e-80edb092695f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:56.415416 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-953b22b4-133c-42bf-9e7e-80edb092695f None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:51:56.416539 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-953b22b4-133c-42bf-9e7e-80edb092695f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:51:56.522257 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0c3f4955-584c-41c4-bd0e-de183960a820 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:56.524608 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 225/440] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:51:56 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:51:56.583471 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdae3c-249e-4672-b431-a061519c6a71 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:56.584569 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdae3c-249e-4672-b431-a061519c6a71 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:56.585097 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdae3c-249e-4672-b431-a061519c6a71 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:56.585593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0fdae3c-249e-4672-b431-a061519c6a71 None admin] PATH_INFO: `/v3/projects/796ee44386c443e8885ece664a23534b` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:56.587503 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdae3c-249e-4672-b431-a061519c6a71 None admin] RBAC: Authorizing `identity:get_project(project_id=796ee44386c443e8885ece664a23534b)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:56.590398 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0fdae3c-249e-4672-b431-a061519c6a71 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:56.593742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 216/441] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:56 2022] GET /identity/v3/projects/796ee44386c443e8885ece664a23534b => generated 302 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:56.602065 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b22b4-133c-42bf-9e7e-80edb092695f None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:56.640511 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:56.731705 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-953b22b4-133c-42bf-9e7e-80edb092695f None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:56.773665 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f45a7-6217-4edd-bd46-403758243e90 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:56.774321 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f45a7-6217-4edd-bd46-403758243e90 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:56.774592 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f45a7-6217-4edd-bd46-403758243e90 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:56.774873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a14f45a7-6217-4edd-bd46-403758243e90 None admin] PATH_INFO: `/v3/groups/609c4d22b8dd425298928e6207cf82bf` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:56.776171 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f45a7-6217-4edd-bd46-403758243e90 None admin] RBAC: Authorizing `identity:get_group(group_id=609c4d22b8dd425298928e6207cf82bf)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:56.777977 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a14f45a7-6217-4edd-bd46-403758243e90 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:56.779125 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdae3c-249e-4672-b431-a061519c6a71 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:56.780013 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 226/442] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:56 2022] GET /identity/v3/groups/609c4d22b8dd425298928e6207cf82bf => generated 226 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:56.785971 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f45a7-6217-4edd-bd46-403758243e90 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:56.799738 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:56.892412 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:56.900804 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a14f45a7-6217-4edd-bd46-403758243e90 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:56.934479 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0fdae3c-249e-4672-b431-a061519c6a71 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:56.953392 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1251a-91b6-432a-81dc-bbd98941b6ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:56.954180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1251a-91b6-432a-81dc-bbd98941b6ae None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:56.954551 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1251a-91b6-432a-81dc-bbd98941b6ae None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:56.954890 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df1251a-91b6-432a-81dc-bbd98941b6ae None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:56.955696 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1251a-91b6-432a-81dc-bbd98941b6ae None admin] RBAC: Adding query filter params (group.id=609c4d22b8dd425298928e6207cf82bf, role.id=54545d831b9e469dad64f2d28c12e462, scope.project.id=796ee44386c443e8885ece664a23534b) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:56.956091 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1251a-91b6-432a-81dc-bbd98941b6ae None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:56.957645 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4df1251a-91b6-432a-81dc-bbd98941b6ae None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:56.964572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 227/443] 10.222.0.49 () {56 vars in 1376 bytes} [Sun Aug 21 00:51:56 2022] GET /identity/v3/role_assignments?group.id=609c4d22b8dd425298928e6207cf82bf&scope.project.id=796ee44386c443e8885ece664a23534b&role.id=54545d831b9e469dad64f2d28c12e462 => generated 611 bytes in 179 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:56.965346 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1251a-91b6-432a-81dc-bbd98941b6ae None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:56.983395 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b141d-390b-480b-9904-5f47628c551e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:56.984097 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b141d-390b-480b-9904-5f47628c551e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:56.984443 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b141d-390b-480b-9904-5f47628c551e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:56.984783 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e9b141d-390b-480b-9904-5f47628c551e None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:57.002116 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e9b141d-390b-480b-9904-5f47628c551e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:57.008531 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-3e9b141d-390b-480b-9904-5f47628c551e None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:57.008531 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:57.008531 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:57.008531 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:57.008531 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:57.008531 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:57.008531 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:57.008531 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:57.008531 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:57.008531 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:57.008531 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:57.008531 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:57.008531 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:57.008531 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:57.008531 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:57.008531 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:57.010647 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:57.010647 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:57.010647 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:57.010647 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:57.010647 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:57.010647 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:57.010647 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:57.010647 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:57.010647 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:57.010647 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:57.010647 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:57.010647 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:57.010647 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:57.010647 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:57.010647 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:57.010647 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:57.012484 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:57.012484 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:57.012484 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:57.012484 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:57.012484 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:57.012484 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:57.012484 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:57.012484 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:57.012484 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:57.012484 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:57.012484 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:51:57.012484 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:51:57.012484 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 217/444] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 21 00:51:56 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 234 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:51:57.021208 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b141d-390b-480b-9904-5f47628c551e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:57.128958 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4df1251a-91b6-432a-81dc-bbd98941b6ae None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:57.131224 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:57.175343 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb125fe-0340-40ec-bbee-cd9c4182c684 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:57.176437 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb125fe-0340-40ec-bbee-cd9c4182c684 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:57.177074 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb125fe-0340-40ec-bbee-cd9c4182c684 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:57.177332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb125fe-0340-40ec-bbee-cd9c4182c684 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:57.188464 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e9b141d-390b-480b-9904-5f47628c551e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:57.200233 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb125fe-0340-40ec-bbee-cd9c4182c684 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:51:57.208843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-1eb125fe-0340-40ec-bbee-cd9c4182c684 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:57.208843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:51:57.208843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:51:57.208843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:51:57.208843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:51:57.208843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:51:57.208843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:51:57.208843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:51:57.208843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:51:57.208843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:51:57.208843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:51:57.208843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:51:57.208843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:51:57.208843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:51:57.208843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:51:57.208843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:51:57.213427 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:51:57.213427 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:51:57.213427 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:51:57.213427 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:51:57.213427 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:51:57.213427 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:51:57.213427 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:51:57.213427 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:51:57.213427 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:51:57.213427 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:51:57.213427 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:51:57.213427 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:51:57.213427 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:51:57.213427 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:51:57.213427 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:51:57.213427 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:51:57.215129 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:51:57.215129 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:51:57.215129 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:51:57.215129 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:51:57.215129 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:51:57.215129 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:51:57.215129 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:51:57.215129 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:51:57.215129 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:51:57.215129 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:51:57.215129 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:51:57.215129 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:51:57.215129 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 228/445] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:51:56 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:51:57.220320 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb125fe-0340-40ec-bbee-cd9c4182c684 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:57.245976 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b8d12-d65f-46f3-b068-bccee5ebc8d0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:57.246534 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b8d12-d65f-46f3-b068-bccee5ebc8d0 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:57.246810 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b8d12-d65f-46f3-b068-bccee5ebc8d0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:57.249416 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-745b8d12-d65f-46f3-b068-bccee5ebc8d0 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:57.249416 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b8d12-d65f-46f3-b068-bccee5ebc8d0 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:57.249416 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b8d12-d65f-46f3-b068-bccee5ebc8d0 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:57.250654 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-745b8d12-d65f-46f3-b068-bccee5ebc8d0 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:57.261434 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 218/446] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:51:57 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:57.262018 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:57.266880 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b8d12-d65f-46f3-b068-bccee5ebc8d0 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:57.385747 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb125fe-0340-40ec-bbee-cd9c4182c684 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:57.432546 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-745b8d12-d65f-46f3-b068-bccee5ebc8d0 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:57.436586 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917037e5-b983-4341-8970-ebc0c0e52694 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:57.437569 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917037e5-b983-4341-8970-ebc0c0e52694 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:57.438020 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917037e5-b983-4341-8970-ebc0c0e52694 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:57.438394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-917037e5-b983-4341-8970-ebc0c0e52694 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:57.439152 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917037e5-b983-4341-8970-ebc0c0e52694 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:57.439517 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917037e5-b983-4341-8970-ebc0c0e52694 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:57.441000 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-917037e5-b983-4341-8970-ebc0c0e52694 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:57.452095 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 229/447] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:51:57 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:57.458326 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917037e5-b983-4341-8970-ebc0c0e52694 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:57.469092 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:57.478159 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb9053-dbde-4a39-ad8e-6bc5c60ceaf8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:57.478930 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb9053-dbde-4a39-ad8e-6bc5c60ceaf8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:57.479419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb9053-dbde-4a39-ad8e-6bc5c60ceaf8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:57.479846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbb9053-dbde-4a39-ad8e-6bc5c60ceaf8 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:57.555704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb9053-dbde-4a39-ad8e-6bc5c60ceaf8 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:57.557235 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7dbb9053-dbde-4a39-ad8e-6bc5c60ceaf8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:57.576407 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:57.597737 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-917037e5-b983-4341-8970-ebc0c0e52694 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:57.646088 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a6bbc-c6d3-4511-8384-a13374c3f012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:57.647034 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a6bbc-c6d3-4511-8384-a13374c3f012 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:57.647482 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a6bbc-c6d3-4511-8384-a13374c3f012 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:57.647917 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-044a6bbc-c6d3-4511-8384-a13374c3f012 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:57.701269 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 219/448] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 435 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:51:57.708167 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb9053-dbde-4a39-ad8e-6bc5c60ceaf8 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:57.741018 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a6bbc-c6d3-4511-8384-a13374c3f012 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:57.742587 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-044a6bbc-c6d3-4511-8384-a13374c3f012 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:57.761499 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:57.847677 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:57.869185 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 230/449] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:51:57 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 411 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 21 00:51:57.876333 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a6bbc-c6d3-4511-8384-a13374c3f012 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:57.877874 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbb9053-dbde-4a39-ad8e-6bc5c60ceaf8 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:57.932555 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ad066-e164-4d93-bccf-548bb6c03d6e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:57.933282 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ad066-e164-4d93-bccf-548bb6c03d6e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:57.933564 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ad066-e164-4d93-bccf-548bb6c03d6e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:57.933838 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df6ad066-e164-4d93-bccf-548bb6c03d6e None admin] PATH_INFO: `/v3/projects/796ee44386c443e8885ece664a23534b` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:57.935027 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ad066-e164-4d93-bccf-548bb6c03d6e None admin] RBAC: Authorizing `identity:get_project(project_id=796ee44386c443e8885ece664a23534b)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:57.936523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df6ad066-e164-4d93-bccf-548bb6c03d6e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:57.938293 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 220/450] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:57 2022] GET /identity/v3/projects/796ee44386c443e8885ece664a23534b => generated 302 bytes in 231 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:57.943952 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ad066-e164-4d93-bccf-548bb6c03d6e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:58.006590 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-044a6bbc-c6d3-4511-8384-a13374c3f012 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:58.050594 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4a9a8-282d-444c-925f-a630cc1355ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:58.051237 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4a9a8-282d-444c-925f-a630cc1355ae None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:58.051510 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4a9a8-282d-444c-925f-a630cc1355ae None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:58.051777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cef4a9a8-282d-444c-925f-a630cc1355ae None admin] PATH_INFO: `/v3/projects/ccef469c265b41be893535a3cf96c82d` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:58.052953 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4a9a8-282d-444c-925f-a630cc1355ae None admin] RBAC: Authorizing `identity:get_project(project_id=ccef469c265b41be893535a3cf96c82d)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:58.054514 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cef4a9a8-282d-444c-925f-a630cc1355ae None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:58.056224 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 231/451] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:51:57 2022] GET /identity/v3/projects/ccef469c265b41be893535a3cf96c82d => generated 344 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:58.062019 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4a9a8-282d-444c-925f-a630cc1355ae None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:58.065085 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:58.069758 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df6ad066-e164-4d93-bccf-548bb6c03d6e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:58.106225 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e76ff-fe5c-46bc-9e1f-12c846e938a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:58.106755 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e76ff-fe5c-46bc-9e1f-12c846e938a0 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:58.107032 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e76ff-fe5c-46bc-9e1f-12c846e938a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:58.107298 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-383e76ff-fe5c-46bc-9e1f-12c846e938a0 None admin] PATH_INFO: `/v3/groups/609c4d22b8dd425298928e6207cf82bf` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:58.108473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e76ff-fe5c-46bc-9e1f-12c846e938a0 None admin] RBAC: Authorizing `identity:get_group(group_id=609c4d22b8dd425298928e6207cf82bf)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:58.109957 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-383e76ff-fe5c-46bc-9e1f-12c846e938a0 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:58.111560 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 221/452] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:57 2022] GET /identity/v3/groups/609c4d22b8dd425298928e6207cf82bf => generated 226 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:58.116688 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:58.119193 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e76ff-fe5c-46bc-9e1f-12c846e938a0 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:58.182865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cef4a9a8-282d-444c-925f-a630cc1355ae None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:58.236080 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373ba4c-16c7-4a26-b106-086bd707f035 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:58.236851 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373ba4c-16c7-4a26-b106-086bd707f035 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:58.237616 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373ba4c-16c7-4a26-b106-086bd707f035 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:58.237616 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8373ba4c-16c7-4a26-b106-086bd707f035 None admin] PATH_INFO: `/v3/groups/5f7a4d30d4aa46adaeb53896401a4ff2` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:58.239032 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373ba4c-16c7-4a26-b106-086bd707f035 None admin] RBAC: Authorizing `identity:get_group(group_id=5f7a4d30d4aa46adaeb53896401a4ff2)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:58.240663 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8373ba4c-16c7-4a26-b106-086bd707f035 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:58.242392 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 232/453] 10.222.0.49 () {56 vars in 1180 bytes} [Sun Aug 21 00:51:58 2022] GET /identity/v3/groups/5f7a4d30d4aa46adaeb53896401a4ff2 => generated 229 bytes in 181 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:51:58.248841 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373ba4c-16c7-4a26-b106-086bd707f035 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:51:58.266143 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-383e76ff-fe5c-46bc-9e1f-12c846e938a0 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:58.328076 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3265346-f4b5-4030-b904-e91759857926 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:58.329135 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3265346-f4b5-4030-b904-e91759857926 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:58.329635 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3265346-f4b5-4030-b904-e91759857926 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:58.330110 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3265346-f4b5-4030-b904-e91759857926 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:58.331603 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3265346-f4b5-4030-b904-e91759857926 None admin] RBAC: Adding query filter params (group.id=609c4d22b8dd425298928e6207cf82bf, role.id=f186b24dc4eb43668f180c85b7c1fc20, scope.project.id=796ee44386c443e8885ece664a23534b) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:58.332124 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3265346-f4b5-4030-b904-e91759857926 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:58.334753 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3265346-f4b5-4030-b904-e91759857926 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:58.346125 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 222/454] 10.222.0.49 () {56 vars in 1376 bytes} [Sun Aug 21 00:51:58 2022] GET /identity/v3/role_assignments?group.id=609c4d22b8dd425298928e6207cf82bf&scope.project.id=796ee44386c443e8885ece664a23534b&role.id=f186b24dc4eb43668f180c85b7c1fc20 => generated 611 bytes in 228 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:51:58.365340 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8373ba4c-16c7-4a26-b106-086bd707f035 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:51:58.388884 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:51:58.414321 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-04affd21-7567-4bc4-bfa0-98e03ce7e5f2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:51:58.415278 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04affd21-7567-4bc4-bfa0-98e03ce7e5f2 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:51:58.415716 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04affd21-7567-4bc4-bfa0-98e03ce7e5f2 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:51:58.416149 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04affd21-7567-4bc4-bfa0-98e03ce7e5f2 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:51:58.417446 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04affd21-7567-4bc4-bfa0-98e03ce7e5f2 None admin] RBAC: Adding query filter params (group.id=5f7a4d30d4aa46adaeb53896401a4ff2, role.id=c73e9539582145ed8eedc48648b9d738, scope.project.id=ccef469c265b41be893535a3cf96c82d) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:51:58.417870 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04affd21-7567-4bc4-bfa0-98e03ce7e5f2 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:51:58.420343 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-04affd21-7567-4bc4-bfa0-98e03ce7e5f2 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:51:58.441103 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 233/455] 10.222.0.49 () {56 vars in 1376 bytes} [Sun Aug 21 00:51:58 2022] GET /identity/v3/role_assignments?group.id=5f7a4d30d4aa46adaeb53896401a4ff2&scope.project.id=ccef469c265b41be893535a3cf96c82d&role.id=c73e9539582145ed8eedc48648b9d738 => generated 611 bytes in 183 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:00.840950 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f761bc-0ef0-4a7b-ba22-2e3865738f73 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:00.841543 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f761bc-0ef0-4a7b-ba22-2e3865738f73 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:00.841543 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f761bc-0ef0-4a7b-ba22-2e3865738f73 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:00.843179 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 223/456] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:00.849065 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c964cf-cb98-4ae4-81da-1e4dcb5bdc07 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:00.850002 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c964cf-cb98-4ae4-81da-1e4dcb5bdc07 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:00.850503 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20c964cf-cb98-4ae4-81da-1e4dcb5bdc07 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:00.877139 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-20c964cf-cb98-4ae4-81da-1e4dcb5bdc07 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:00.878757 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-20c964cf-cb98-4ae4-81da-1e4dcb5bdc07 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:00.965613 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 234/457] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:00 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 117 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:01.322181 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f761bc-0ef0-4a7b-ba22-2e3865738f73 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:01.359484 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63596929-2198-4a09-810a-089e753d4eca None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:01.360195 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63596929-2198-4a09-810a-089e753d4eca None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:01.360748 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63596929-2198-4a09-810a-089e753d4eca None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:01.362755 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 235/458] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:01 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:52:01.373222 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:01.391358 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc603950-6b66-4c03-a8a0-39f3aa13f9da None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:01.392236 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc603950-6b66-4c03-a8a0-39f3aa13f9da None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:01.392843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc603950-6b66-4c03-a8a0-39f3aa13f9da None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:01.452618 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-bc603950-6b66-4c03-a8a0-39f3aa13f9da None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:01.454268 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-bc603950-6b66-4c03-a8a0-39f3aa13f9da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:01.515409 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f761bc-0ef0-4a7b-ba22-2e3865738f73 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:01.577559 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e838867-3d6d-404e-a848-c3e6890fa364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:01.578986 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e838867-3d6d-404e-a848-c3e6890fa364 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:01.579711 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e838867-3d6d-404e-a848-c3e6890fa364 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:01.580383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e838867-3d6d-404e-a848-c3e6890fa364 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:01.601193 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e838867-3d6d-404e-a848-c3e6890fa364 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:01.604078 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e838867-3d6d-404e-a848-c3e6890fa364 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:01.640955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-6e838867-3d6d-404e-a848-c3e6890fa364 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:01.640955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:01.640955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:01.640955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:01.640955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:01.640955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:01.640955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:01.640955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:01.640955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:01.640955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:01.640955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:01.640955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:01.640955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:01.640955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:01.640955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:01.640955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:01.643082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:01.643082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:01.643082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:01.643082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:01.643082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:01.643082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:01.643082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:01.643082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:01.643082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:01.643082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:01.643082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:01.643082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:01.643082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:01.643082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:01.643082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:01.643082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:01.643082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:01.654277 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:01.654277 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:01.654277 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:01.654277 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 224/459] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:01.655579 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 236/460] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:01 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 265 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:52:01.657064 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e838867-3d6d-404e-a848-c3e6890fa364 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:01.868160 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:01.916023 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e838867-3d6d-404e-a848-c3e6890fa364 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:01.999864 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc8f41-cbf2-4ddb-895a-f9b6e6545662 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:02.001216 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc8f41-cbf2-4ddb-895a-f9b6e6545662 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:02.001699 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc8f41-cbf2-4ddb-895a-f9b6e6545662 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:02.002171 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7cc8f41-cbf2-4ddb-895a-f9b6e6545662 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:02.003363 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc8f41-cbf2-4ddb-895a-f9b6e6545662 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:02.003896 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc8f41-cbf2-4ddb-895a-f9b6e6545662 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:02.006544 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7cc8f41-cbf2-4ddb-895a-f9b6e6545662 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:02.034070 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 225/461] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 378 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:02.043755 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc603950-6b66-4c03-a8a0-39f3aa13f9da None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:02.106196 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc8f41-cbf2-4ddb-895a-f9b6e6545662 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:02.139469 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:02.248781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc603950-6b66-4c03-a8a0-39f3aa13f9da None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:02.311978 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9255d994-fc05-42e8-a13e-845799d49f81 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:02.313321 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255d994-fc05-42e8-a13e-845799d49f81 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:02.313942 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255d994-fc05-42e8-a13e-845799d49f81 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:02.314495 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9255d994-fc05-42e8-a13e-845799d49f81 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:02.315702 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255d994-fc05-42e8-a13e-845799d49f81 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:02.318521 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9255d994-fc05-42e8-a13e-845799d49f81 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:02.354947 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 237/462] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 21 00:52:02 2022] POST /identity/v3/users => generated 246 bytes in 312 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:52:02.357472 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d5715-c321-46ec-b4f3-1870642791ff None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:02.358123 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d5715-c321-46ec-b4f3-1870642791ff None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:02.358676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba5d5715-c321-46ec-b4f3-1870642791ff None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:02.365944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7cc8f41-cbf2-4ddb-895a-f9b6e6545662 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:02.368904 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 238/463] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:02 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:02.372365 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e66c6-b4ea-4f3c-ac63-bba1bc475562 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:02.372658 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e66c6-b4ea-4f3c-ac63-bba1bc475562 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:02.372979 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-888e66c6-b4ea-4f3c-ac63-bba1bc475562 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:02.404434 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-888e66c6-b4ea-4f3c-ac63-bba1bc475562 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:02.406891 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-888e66c6-b4ea-4f3c-ac63-bba1bc475562 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:02.430651 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88da369-d477-4b26-ae2b-1f580d197495 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:02.432174 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88da369-d477-4b26-ae2b-1f580d197495 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:02.432932 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88da369-d477-4b26-ae2b-1f580d197495 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:02.433664 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c88da369-d477-4b26-ae2b-1f580d197495 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:02.451873 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88da369-d477-4b26-ae2b-1f580d197495 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:02.454762 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c88da369-d477-4b26-ae2b-1f580d197495 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:02.458168 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:02.482938 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-c88da369-d477-4b26-ae2b-1f580d197495 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:02.482938 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:02.482938 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:02.482938 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:02.482938 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:02.482938 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:02.482938 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:02.482938 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:02.482938 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:02.482938 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:02.482938 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:02.482938 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:02.482938 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:02.482938 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:02.482938 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:02.482938 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:02.484616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:02.484616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:02.484616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:02.484616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:02.484616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:02.484616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:02.484616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:02.484616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:02.484616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:02.484616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:02.484616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:02.484616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:02.484616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:02.484616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:02.484616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:02.484616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:02.484616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:02.486265 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:02.486265 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:02.486265 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:02.489773 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 226/464] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:02 2022] GET /identity/v3/domains/Default => generated 87 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:02.498892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88da369-d477-4b26-ae2b-1f580d197495 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:02.545484 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 239/465] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:02.712018 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c88da369-d477-4b26-ae2b-1f580d197495 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:02.778169 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5684510b-5c76-40e5-9f63-fb879f8f03ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:02.779146 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684510b-5c76-40e5-9f63-fb879f8f03ea None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:02.779614 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684510b-5c76-40e5-9f63-fb879f8f03ea None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:02.780083 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5684510b-5c76-40e5-9f63-fb879f8f03ea None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:02.783571 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684510b-5c76-40e5-9f63-fb879f8f03ea None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:02.784122 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684510b-5c76-40e5-9f63-fb879f8f03ea None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:02.786952 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5684510b-5c76-40e5-9f63-fb879f8f03ea None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:02.812585 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 227/466] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:02 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:02.818556 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e66c6-b4ea-4f3c-ac63-bba1bc475562 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:02.870470 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:02.941967 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d7f70-02c6-43d7-a3d6-0d36a783c846 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:02.942775 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d7f70-02c6-43d7-a3d6-0d36a783c846 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:02.944227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-404d7f70-02c6-43d7-a3d6-0d36a783c846 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:02.946914 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 228/467] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:02 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:02.958936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdce33f-f41e-4718-a7c9-c5e36c3b0075 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:02.959376 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdce33f-f41e-4718-a7c9-c5e36c3b0075 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:02.959811 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bcdce33f-f41e-4718-a7c9-c5e36c3b0075 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:02.988986 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-888e66c6-b4ea-4f3c-ac63-bba1bc475562 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:02.996619 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-bcdce33f-f41e-4718-a7c9-c5e36c3b0075 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:02.999384 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-bcdce33f-f41e-4718-a7c9-c5e36c3b0075 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:03.031832 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff6c40-696b-403a-b34d-cfae65aed007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:03.032455 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff6c40-696b-403a-b34d-cfae65aed007 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:03.032707 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff6c40-696b-403a-b34d-cfae65aed007 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:03.032956 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95ff6c40-696b-403a-b34d-cfae65aed007 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:03.034027 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff6c40-696b-403a-b34d-cfae65aed007 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:03.035745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95ff6c40-696b-403a-b34d-cfae65aed007 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:03.062737 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 240/468] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 21 00:52:02 2022] POST /identity/v3/users => generated 248 bytes in 245 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:52:03.108834 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:03.146660 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 229/469] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:02 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:52:03.167636 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff6c40-696b-403a-b34d-cfae65aed007 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:03.315165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:03.354789 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95ff6c40-696b-403a-b34d-cfae65aed007 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:03.401142 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea48720-ae9e-4f2f-a927-cf6a32adf93d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:03.401851 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea48720-ae9e-4f2f-a927-cf6a32adf93d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:03.402106 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea48720-ae9e-4f2f-a927-cf6a32adf93d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:03.402370 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cea48720-ae9e-4f2f-a927-cf6a32adf93d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:03.414416 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea48720-ae9e-4f2f-a927-cf6a32adf93d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:03.415947 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cea48720-ae9e-4f2f-a927-cf6a32adf93d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:03.431565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-cea48720-ae9e-4f2f-a927-cf6a32adf93d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:03.431565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:03.431565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:03.431565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:03.431565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:03.431565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:03.431565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:03.431565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:03.431565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:03.431565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:03.431565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:03.431565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:03.431565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:03.431565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:03.431565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:03.431565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:03.433320 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:03.433320 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:03.433320 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:03.433320 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:03.433320 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:03.433320 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:03.433320 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:03.433320 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:03.433320 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:03.433320 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:03.433320 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:03.433320 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:03.433320 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:03.433320 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:03.433320 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:03.433320 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:03.433320 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:03.437304 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:03.437304 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:03.437304 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:03.437304 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 241/470] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 266 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:03.445437 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdce33f-f41e-4718-a7c9-c5e36c3b0075 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:03.637111 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bcdce33f-f41e-4718-a7c9-c5e36c3b0075 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:03.701368 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea48720-ae9e-4f2f-a927-cf6a32adf93d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:03.706207 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844037c-f041-4ed2-8e28-3c478da24349 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:03.707290 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844037c-f041-4ed2-8e28-3c478da24349 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:03.707743 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844037c-f041-4ed2-8e28-3c478da24349 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:03.708191 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7844037c-f041-4ed2-8e28-3c478da24349 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:03.709557 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844037c-f041-4ed2-8e28-3c478da24349 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:03.710764 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844037c-f041-4ed2-8e28-3c478da24349 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:03.712418 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7844037c-f041-4ed2-8e28-3c478da24349 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:03.740320 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 230/471] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:03.748658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844037c-f041-4ed2-8e28-3c478da24349 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:03.879296 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:03.909765 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cea48720-ae9e-4f2f-a927-cf6a32adf93d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:03.956520 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7844037c-f041-4ed2-8e28-3c478da24349 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:03.973882 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ad6ec-b009-468e-b562-940634603c25 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:03.975462 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ad6ec-b009-468e-b562-940634603c25 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:03.976366 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ad6ec-b009-468e-b562-940634603c25 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:03.977172 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-349ad6ec-b009-468e-b562-940634603c25 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:03.982840 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:04.002323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ad6ec-b009-468e-b562-940634603c25 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:04.003826 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-349ad6ec-b009-468e-b562-940634603c25 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:04.004940 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-43427938-d6eb-4ba2-9c4e-5cb3b932ae53 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:04.005591 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43427938-d6eb-4ba2-9c4e-5cb3b932ae53 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:04.005855 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43427938-d6eb-4ba2-9c4e-5cb3b932ae53 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:04.006125 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43427938-d6eb-4ba2-9c4e-5cb3b932ae53 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:04.006770 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43427938-d6eb-4ba2-9c4e-5cb3b932ae53 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:04.008205 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-43427938-d6eb-4ba2-9c4e-5cb3b932ae53 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:04.032721 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 231/472] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 21 00:52:03 2022] POST /identity/v3/users => generated 248 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:52:04.034143 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06e6db-b949-45ee-9c25-7731bd9f4b57 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:04.034436 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06e6db-b949-45ee-9c25-7731bd9f4b57 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:04.034760 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd06e6db-b949-45ee-9c25-7731bd9f4b57 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:04.037084 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 232/473] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:04 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:04.045504 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebcf04-b185-49b6-9505-2f43316ce95c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:04.046305 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebcf04-b185-49b6-9505-2f43316ce95c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:04.046949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cebcf04-b185-49b6-9505-2f43316ce95c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:04.048838 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-349ad6ec-b009-468e-b562-940634603c25 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:04.048838 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:04.048838 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:04.048838 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:04.048838 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:04.048838 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:04.048838 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:04.048838 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:04.048838 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:04.048838 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:04.048838 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:04.048838 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:04.048838 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:04.048838 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:04.048838 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:04.048838 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:04.049974 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:04.049974 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:04.049974 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:04.049974 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:04.049974 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:04.049974 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:04.049974 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:04.049974 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:04.049974 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:04.049974 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:04.049974 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:04.049974 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:04.049974 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:04.049974 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:04.049974 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:04.049974 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:04.049974 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:04.050857 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:04.050857 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:04.050857 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:04.051459 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 242/474] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 350 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:04.061384 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ad6ec-b009-468e-b562-940634603c25 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:04.089525 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-8cebcf04-b185-49b6-9505-2f43316ce95c None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:04.091331 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8cebcf04-b185-49b6-9505-2f43316ce95c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:04.301072 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-349ad6ec-b009-468e-b562-940634603c25 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:04.301642 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 233/475] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:04 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 254 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:52:04.381510 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281e133-a1b2-403c-bb34-d8ec6dd946e2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:04.382526 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281e133-a1b2-403c-bb34-d8ec6dd946e2 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:04.383001 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281e133-a1b2-403c-bb34-d8ec6dd946e2 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:04.383467 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3281e133-a1b2-403c-bb34-d8ec6dd946e2 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:04.384617 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281e133-a1b2-403c-bb34-d8ec6dd946e2 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:04.385151 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281e133-a1b2-403c-bb34-d8ec6dd946e2 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:04.387689 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3281e133-a1b2-403c-bb34-d8ec6dd946e2 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:04.419742 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 243/476] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:04.428892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebcf04-b185-49b6-9505-2f43316ce95c None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:04.487813 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:04.646270 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cebcf04-b185-49b6-9505-2f43316ce95c None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:04.717000 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556e094-25dd-4e78-b183-036c43ec7ad3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:04.718106 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556e094-25dd-4e78-b183-036c43ec7ad3 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:04.718586 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556e094-25dd-4e78-b183-036c43ec7ad3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:04.719036 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0556e094-25dd-4e78-b183-036c43ec7ad3 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:04.720201 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556e094-25dd-4e78-b183-036c43ec7ad3 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:04.722942 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0556e094-25dd-4e78-b183-036c43ec7ad3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:04.771675 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 234/477] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 21 00:52:04 2022] POST /identity/v3/users => generated 249 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:52:04.945717 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281e133-a1b2-403c-bb34-d8ec6dd946e2 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:05.064401 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:05.183495 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3281e133-a1b2-403c-bb34-d8ec6dd946e2 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:05.254027 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e930a-3ad0-446a-8c46-036bdc82896c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:05.255203 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e930a-3ad0-446a-8c46-036bdc82896c None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:05.255696 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e930a-3ad0-446a-8c46-036bdc82896c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:05.256200 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f2e930a-3ad0-446a-8c46-036bdc82896c None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:05.257389 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e930a-3ad0-446a-8c46-036bdc82896c None admin] RBAC: Authorizing `identity:create_role()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:05.260309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f2e930a-3ad0-446a-8c46-036bdc82896c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:05.277059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.sql.core [None req-6f2e930a-3ad0-446a-8c46-036bdc82896c None admin] Conflict role: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 21 00:52:05.277059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 21 00:52:05.277059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [parameters: {'id': 'a1c49c90524c4282aac98fcc75837f68', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 21 00:52:05.277059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81578) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 21 00:52:05.311699 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-6f2e930a-3ad0-446a-8c46-036bdc82896c None admin] Conflict occurred attempting to store role - Duplicate entry found with name anotherrole.: keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 21 00:52:05.311699 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:05.311699 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 00:52:05.311699 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 21 00:52:05.311699 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 00:52:05.311699 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 21 00:52:05.311699 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 00:52:05.311699 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application result = self._query(query) Aug 21 00:52:05.311699 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 00:52:05.311699 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application conn.query(q) Aug 21 00:52:05.311699 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 00:52:05.311699 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 00:52:05.311699 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 00:52:05.311699 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application result.read() Aug 21 00:52:05.311699 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 00:52:05.314001 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 21 00:52:05.314001 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 00:52:05.314001 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 21 00:52:05.314001 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 00:52:05.314001 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 21 00:52:05.314001 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 00:52:05.314001 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 21 00:52:05.314001 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 21 00:52:05.314001 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:05.314001 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 21 00:52:05.314001 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:05.314001 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:05.314001 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 21 00:52:05.314001 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 21 00:52:05.314001 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 33, in create_role Aug 21 00:52:05.314001 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return ref.to_dict() Aug 21 00:52:05.314001 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 21 00:52:05.314001 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application next(self.gen) Aug 21 00:52:05.316636 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 21 00:52:05.316636 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application yield resource Aug 21 00:52:05.316636 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 21 00:52:05.316636 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application next(self.gen) Aug 21 00:52:05.316636 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 21 00:52:05.316636 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self.session.rollback() Aug 21 00:52:05.316636 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 00:52:05.316636 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self.force_reraise() Aug 21 00:52:05.316636 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 00:52:05.316636 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise self.value Aug 21 00:52:05.316636 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 21 00:52:05.316636 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 21 00:52:05.316636 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 21 00:52:05.316636 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application session.commit() Aug 21 00:52:05.316636 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 21 00:52:05.316636 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 21 00:52:05.316636 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 21 00:52:05.318734 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._prepare_impl() Aug 21 00:52:05.318734 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 21 00:52:05.318734 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self.session.flush() Aug 21 00:52:05.318734 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 21 00:52:05.318734 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._flush(objects) Aug 21 00:52:05.318734 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 21 00:52:05.318734 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 21 00:52:05.318734 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 21 00:52:05.318734 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application compat.raise_( Aug 21 00:52:05.318734 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 00:52:05.318734 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception Aug 21 00:52:05.318734 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 21 00:52:05.318734 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application flush_context.execute() Aug 21 00:52:05.318734 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 21 00:52:05.318734 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rec.execute(self) Aug 21 00:52:05.318734 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 21 00:52:05.318734 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 21 00:52:05.320807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 21 00:52:05.320807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 21 00:52:05.320807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 21 00:52:05.320807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 21 00:52:05.320807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 21 00:52:05.320807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 21 00:52:05.320807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 21 00:52:05.320807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 21 00:52:05.320807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 21 00:52:05.320807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 21 00:52:05.320807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 21 00:52:05.320807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 21 00:52:05.320807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 21 00:52:05.320807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 21 00:52:05.320807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 00:52:05.320807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception Aug 21 00:52:05.327994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 00:52:05.327994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 21 00:52:05.327994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 00:52:05.327994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 21 00:52:05.327994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 00:52:05.327994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application result = self._query(query) Aug 21 00:52:05.327994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 00:52:05.327994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application conn.query(q) Aug 21 00:52:05.327994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 00:52:05.327994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 00:52:05.327994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 00:52:05.327994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application result.read() Aug 21 00:52:05.327994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 00:52:05.327994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 21 00:52:05.327994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 00:52:05.327994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 21 00:52:05.331058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 00:52:05.331058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 21 00:52:05.331058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 00:52:05.331058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 21 00:52:05.331058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'anotherrole-<>' for key 'role.ixu_role_name_domain_id'") Aug 21 00:52:05.331058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [SQL: INSERT INTO `role` (id, name, description, extra) VALUES (%(id)s, %(name)s, %(description)s, %(extra)s)] Aug 21 00:52:05.331058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [parameters: {'id': 'a1c49c90524c4282aac98fcc75837f68', 'name': 'anotherrole', 'description': None, 'extra': '{}'}] Aug 21 00:52:05.331058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 21 00:52:05.331058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:05.331058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:05.331058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:05.331058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:05.331058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:05.331058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:05.331058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:05.331058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:05.334059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:05.334059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:05.334059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:05.334059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:05.334059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:05.334059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:05.334059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 115, in post Aug 21 00:52:05.334059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.role_api.create_role( Aug 21 00:52:05.334059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:05.334059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:05.334059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1298, in create_role Aug 21 00:52:05.334059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ret = self.driver.create_role(role_id, role) Aug 21 00:52:05.334059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 21 00:52:05.334059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 21 00:52:05.334059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store role - Duplicate entry found with name anotherrole. Aug 21 00:52:05.334059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:05.341134 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 244/478] 10.222.0.49 () {60 vars in 1131 bytes} [Sun Aug 21 00:52:04 2022] POST /identity/v3/roles => generated 144 bytes in 370 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:05.341430 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556e094-25dd-4e78-b183-036c43ec7ad3 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:05.506500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:05.539371 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0556e094-25dd-4e78-b183-036c43ec7ad3 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:05.615199 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7490bfa1-0723-4ce7-8fd0-c62fc0b04095 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:05.616172 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490bfa1-0723-4ce7-8fd0-c62fc0b04095 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:05.616659 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490bfa1-0723-4ce7-8fd0-c62fc0b04095 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:05.617180 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7490bfa1-0723-4ce7-8fd0-c62fc0b04095 None admin] PATH_INFO: `/v3/roles/anotherrole` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:05.639470 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7490bfa1-0723-4ce7-8fd0-c62fc0b04095 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:05.650302 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-7490bfa1-0723-4ce7-8fd0-c62fc0b04095 None admin] Could not find role: anotherrole.: keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:52:05.650302 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:05.650302 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:05.650302 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:05.650302 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:05.650302 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:05.650302 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:05.650302 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:05.650302 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:05.650302 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:05.650302 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:05.650302 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:05.650302 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:05.650302 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:05.650302 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:05.650302 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:05.653863 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:05.653863 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:05.653863 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:05.653863 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:05.653863 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:05.653863 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:05.653863 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:05.653863 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:05.653863 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:05.653863 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:05.653863 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:05.653863 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:05.653863 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:05.653863 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:05.653863 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:05.653863 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:05.657074 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:05.657074 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:05.657074 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:05.657074 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:05.657074 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:05.657074 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:05.657074 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:05.657074 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:05.657074 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:05.657074 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:05.657074 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: anotherrole. Aug 21 00:52:05.657074 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:05.657074 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 235/479] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 21 00:52:05 2022] GET /identity/v3/roles/anotherrole => generated 89 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:05.666065 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e930a-3ad0-446a-8c46-036bdc82896c None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:05.894908 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f2e930a-3ad0-446a-8c46-036bdc82896c None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:05.925629 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:05.965823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d5f1b96-9430-4468-b073-efcd3905f9c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:05.966870 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f1b96-9430-4468-b073-efcd3905f9c3 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:05.967354 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f1b96-9430-4468-b073-efcd3905f9c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:05.967826 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d5f1b96-9430-4468-b073-efcd3905f9c3 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:05.969260 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f1b96-9430-4468-b073-efcd3905f9c3 None admin] RBAC: Adding query filter params (name=anotherrole) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:05.969869 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f1b96-9430-4468-b073-efcd3905f9c3 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:05.972506 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d5f1b96-9430-4468-b073-efcd3905f9c3 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:05.989487 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 245/480] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:05 2022] GET /identity/v3/roles?name=anotherrole => generated 334 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:06.877234 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fc500-f9dd-471e-baba-13a8e32bf981 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:06.878747 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fc500-f9dd-471e-baba-13a8e32bf981 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:06.879477 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d78fc500-f9dd-471e-baba-13a8e32bf981 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:06.882832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 236/481] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:06 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:06.892561 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176f010-733f-4c16-a2e1-76bd84482fc1 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:06.894144 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176f010-733f-4c16-a2e1-76bd84482fc1 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:06.894896 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c176f010-733f-4c16-a2e1-76bd84482fc1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:06.927742 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-c176f010-733f-4c16-a2e1-76bd84482fc1 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:06.930583 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c176f010-733f-4c16-a2e1-76bd84482fc1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:07.090503 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 246/482] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:06 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:07.138826 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2516f-f35f-4ae4-bbcf-b724b5c48c91 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:07.139805 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2516f-f35f-4ae4-bbcf-b724b5c48c91 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:07.140615 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa2516f-f35f-4ae4-bbcf-b724b5c48c91 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:07.144173 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 237/483] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:07 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:07.162048 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dfa1c-ce82-4e2c-ace0-50eef198aa97 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:07.162538 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dfa1c-ce82-4e2c-ace0-50eef198aa97 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:07.163014 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782dfa1c-ce82-4e2c-ace0-50eef198aa97 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:07.201112 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-782dfa1c-ce82-4e2c-ace0-50eef198aa97 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:07.202330 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-782dfa1c-ce82-4e2c-ace0-50eef198aa97 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:07.328076 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 247/484] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:07.395288 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2516f-f35f-4ae4-bbcf-b724b5c48c91 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:07.632791 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa2516f-f35f-4ae4-bbcf-b724b5c48c91 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:07.688874 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bd4bc3c-94cb-45d4-be87-02c80930f3f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:07.689977 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4bc3c-94cb-45d4-be87-02c80930f3f0 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:07.690453 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4bc3c-94cb-45d4-be87-02c80930f3f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:07.690919 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bd4bc3c-94cb-45d4-be87-02c80930f3f0 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:07.703395 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bd4bc3c-94cb-45d4-be87-02c80930f3f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:07.709440 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-9bd4bc3c-94cb-45d4-be87-02c80930f3f0 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:07.709440 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:07.709440 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:07.709440 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:07.709440 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:07.709440 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:07.709440 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:07.709440 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:07.709440 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:07.709440 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:07.709440 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:07.709440 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:07.709440 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:07.709440 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:07.709440 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:07.709440 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:07.710400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:07.710400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:07.710400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:07.710400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:07.710400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:07.710400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:07.710400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:07.710400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:07.710400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:07.710400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:07.710400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:07.710400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:07.710400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:07.710400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:07.710400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:07.710400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:07.711198 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:07.711198 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:07.711198 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:07.711198 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:07.711198 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:07.711198 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:07.711198 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:07.711198 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:07.711198 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:07.711198 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:07.711198 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:07.711198 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:07.714167 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 238/485] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:07 2022] GET /identity/v3/roles/service => generated 85 bytes in 320 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:07.720684 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782dfa1c-ce82-4e2c-ace0-50eef198aa97 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:07.812752 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:07.896235 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadf3cb-8caf-4066-9f92-8d9a93a68f35 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:07.897110 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadf3cb-8caf-4066-9f92-8d9a93a68f35 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:07.897243 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5eadf3cb-8caf-4066-9f92-8d9a93a68f35 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:07.899980 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 239/486] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:07 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:07.912984 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd1dcb-cb92-48cf-818d-86e89bdfb5e6 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:07.914010 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd1dcb-cb92-48cf-818d-86e89bdfb5e6 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:07.914784 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbd1dcb-cb92-48cf-818d-86e89bdfb5e6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:07.933876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-782dfa1c-ce82-4e2c-ace0-50eef198aa97 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:07.956805 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-7dbd1dcb-cb92-48cf-818d-86e89bdfb5e6 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:07.960029 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7dbd1dcb-cb92-48cf-818d-86e89bdfb5e6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:07.977395 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:08.015211 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282cd2c-1982-47cb-aff0-895931b98330 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:08.016268 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282cd2c-1982-47cb-aff0-895931b98330 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:08.016776 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282cd2c-1982-47cb-aff0-895931b98330 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:08.017281 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8282cd2c-1982-47cb-aff0-895931b98330 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:08.018218 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282cd2c-1982-47cb-aff0-895931b98330 None admin] RBAC: Adding query filter params (name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:08.018733 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282cd2c-1982-47cb-aff0-895931b98330 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:08.020385 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8282cd2c-1982-47cb-aff0-895931b98330 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:08.030837 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 248/487] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:07 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:08.032059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282cd2c-1982-47cb-aff0-895931b98330 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:08.097071 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 240/488] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:07 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 181 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:08.097071 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd1dcb-cb92-48cf-818d-86e89bdfb5e6 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:08.168040 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:08.180507 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8282cd2c-1982-47cb-aff0-895931b98330 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:08.265860 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7dbd1dcb-cb92-48cf-818d-86e89bdfb5e6 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:08.304384 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44cb72-bf42-42d5-8957-e6b63e3fc2ff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:08.305334 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44cb72-bf42-42d5-8957-e6b63e3fc2ff None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:08.305769 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44cb72-bf42-42d5-8957-e6b63e3fc2ff None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:08.306186 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f44cb72-bf42-42d5-8957-e6b63e3fc2ff None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:08.309510 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:08.319607 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44cb72-bf42-42d5-8957-e6b63e3fc2ff None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:08.321386 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f44cb72-bf42-42d5-8957-e6b63e3fc2ff None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:08.326180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5ae6f-cb07-4e14-a2f8-ad4b71dc5fea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:08.327212 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5ae6f-cb07-4e14-a2f8-ad4b71dc5fea None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:08.327657 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5ae6f-cb07-4e14-a2f8-ad4b71dc5fea None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:08.328085 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fd5ae6f-cb07-4e14-a2f8-ad4b71dc5fea None admin] PATH_INFO: `/v3/roles/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:08.338944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-4f44cb72-bf42-42d5-8957-e6b63e3fc2ff None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:08.338944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:08.338944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:08.338944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:08.338944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:08.338944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:08.338944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:08.338944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:08.338944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:08.338944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:08.338944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:08.338944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:08.338944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:08.338944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:08.338944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:08.338944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:08.340189 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:08.340189 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:08.340189 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:08.340189 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:08.340189 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:08.340189 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:08.340189 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:08.340189 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:08.340189 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:08.340189 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:08.340189 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:08.340189 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:08.340189 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:08.340189 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:08.340189 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:08.340189 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:08.340189 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:08.341249 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:08.341249 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:08.341249 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:08.342974 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 241/489] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 250 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:08.359446 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44cb72-bf42-42d5-8957-e6b63e3fc2ff None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:08.364484 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9fd5ae6f-cb07-4e14-a2f8-ad4b71dc5fea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:08.374010 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-9fd5ae6f-cb07-4e14-a2f8-ad4b71dc5fea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:08.374010 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:08.374010 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:08.374010 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:08.374010 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:08.374010 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:08.374010 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:08.374010 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:08.374010 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:08.374010 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:08.374010 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:08.374010 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:08.374010 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:08.374010 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:08.374010 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:08.374010 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:08.374952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:08.374952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:08.374952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:08.374952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:08.374952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:08.374952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:08.374952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:08.374952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:08.374952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:08.374952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:08.374952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:08.374952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:08.374952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:08.374952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:08.374952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:08.374952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:08.376024 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:08.376024 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:08.376024 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:08.376024 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:08.376024 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:08.376024 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:08.376024 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:08.376024 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:08.376024 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:08.376024 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:08.376024 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:08.376024 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:08.376024 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 249/490] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:08.394090 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5ae6f-cb07-4e14-a2f8-ad4b71dc5fea None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:08.486448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f44cb72-bf42-42d5-8957-e6b63e3fc2ff None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:08.504551 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fd5ae6f-cb07-4e14-a2f8-ad4b71dc5fea None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:08.526596 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130cdebd-109d-4302-9932-1b931ff8d487 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:08.527227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cdebd-109d-4302-9932-1b931ff8d487 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:08.527507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cdebd-109d-4302-9932-1b931ff8d487 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:08.527806 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130cdebd-109d-4302-9932-1b931ff8d487 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:08.528482 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cdebd-109d-4302-9932-1b931ff8d487 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:08.528833 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cdebd-109d-4302-9932-1b931ff8d487 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:08.530407 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-130cdebd-109d-4302-9932-1b931ff8d487 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:08.543423 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 242/491] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 184 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:08.544711 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467b90b-50a7-43f9-91a6-816c54afe0aa None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:08.544997 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467b90b-50a7-43f9-91a6-816c54afe0aa None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:08.545304 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a467b90b-50a7-43f9-91a6-816c54afe0aa None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:08.546695 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 243/492] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:08.547231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467b90b-50a7-43f9-91a6-816c54afe0aa None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:08.552945 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5b0fe-dee0-4d5a-b728-4003ebfd06e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:08.553614 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5b0fe-dee0-4d5a-b728-4003ebfd06e6 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:08.553939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5b0fe-dee0-4d5a-b728-4003ebfd06e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:08.554213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b5b0fe-dee0-4d5a-b728-4003ebfd06e6 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:08.555396 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5b0fe-dee0-4d5a-b728-4003ebfd06e6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:08.556726 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5b0fe-dee0-4d5a-b728-4003ebfd06e6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:08.558256 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b5b0fe-dee0-4d5a-b728-4003ebfd06e6 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:08.570955 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 250/493] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:08.574499 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5b0fe-dee0-4d5a-b728-4003ebfd06e6 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:08.594401 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:08.605588 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:08.660527 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a467b90b-50a7-43f9-91a6-816c54afe0aa None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:08.689702 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b5b0fe-dee0-4d5a-b728-4003ebfd06e6 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:08.701372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc54b1be-abb4-4c58-b1e5-ee7352714c1e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:08.702034 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54b1be-abb4-4c58-b1e5-ee7352714c1e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:08.702315 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54b1be-abb4-4c58-b1e5-ee7352714c1e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:08.702582 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc54b1be-abb4-4c58-b1e5-ee7352714c1e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:08.715238 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc54b1be-abb4-4c58-b1e5-ee7352714c1e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:08.720179 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-bc54b1be-abb4-4c58-b1e5-ee7352714c1e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:08.720179 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:08.720179 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:08.720179 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:08.720179 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:08.720179 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:08.720179 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:08.720179 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:08.720179 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:08.720179 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:08.720179 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:08.720179 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:08.720179 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:08.720179 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:08.720179 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:08.720179 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:08.721383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:08.721383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:08.721383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:08.721383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:08.721383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:08.721383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:08.721383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:08.721383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:08.721383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:08.721383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:08.721383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:08.721383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:08.721383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:08.721383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:08.721383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:08.721383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:08.722200 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:08.722200 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:08.722200 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:08.722200 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:08.722200 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:08.722200 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:08.722200 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:08.722200 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:08.722200 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:08.722200 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:08.722200 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:08.722200 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:08.722200 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 244/494] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:08 2022] GET /identity/v3/roles/service => generated 85 bytes in 174 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:08.723049 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb309c1-07a8-4368-8f7c-b26be418b3ff None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:08.723333 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb309c1-07a8-4368-8f7c-b26be418b3ff None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:08.723603 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cb309c1-07a8-4368-8f7c-b26be418b3ff None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:08.737937 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d2d9f-3b74-43c4-bea0-6767c18740c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:08.739090 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d2d9f-3b74-43c4-bea0-6767c18740c4 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:08.739572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d2d9f-3b74-43c4-bea0-6767c18740c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:08.740029 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a25d2d9f-3b74-43c4-bea0-6767c18740c4 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:08.742393 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-0cb309c1-07a8-4368-8f7c-b26be418b3ff None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:08.743630 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0cb309c1-07a8-4368-8f7c-b26be418b3ff None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:08.749429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d2d9f-3b74-43c4-bea0-6767c18740c4 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:08.751498 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a25d2d9f-3b74-43c4-bea0-6767c18740c4 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:08.765122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-a25d2d9f-3b74-43c4-bea0-6767c18740c4 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:52:08.765122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:08.765122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:08.765122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:08.765122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:08.765122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:08.765122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:08.765122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:08.765122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:08.765122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:08.765122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:08.765122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:08.765122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:08.765122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:08.765122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:08.765122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:08.766192 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:08.766192 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:08.766192 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:08.766192 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:08.766192 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:08.766192 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:08.766192 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:08.766192 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:08.766192 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:08.766192 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:08.766192 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:08.766192 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:08.766192 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:08.766192 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:08.766192 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:08.766192 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:08.766192 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:08.766192 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:08.771999 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:08.771999 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:08.771999 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:08.771999 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:08.771999 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:08.771999 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:08.771999 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:08.771999 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:08.771999 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:52:08.771999 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:08.771999 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 251/495] 10.222.0.49 () {56 vars in 1093 bytes} [Sun Aug 21 00:52:08 2022] GET /identity/v3/users/nova => generated 82 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:08.771999 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d2d9f-3b74-43c4-bea0-6767c18740c4 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:08.829795 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 245/496] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:08 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:08.829795 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb309c1-07a8-4368-8f7c-b26be418b3ff None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:08.880079 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:08.893922 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:08.927314 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a25d2d9f-3b74-43c4-bea0-6767c18740c4 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:08.989312 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc976823-154c-4354-9654-c6d65e33d95d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:08.990599 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc976823-154c-4354-9654-c6d65e33d95d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:08.991113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc976823-154c-4354-9654-c6d65e33d95d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:08.991647 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc976823-154c-4354-9654-c6d65e33d95d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:08.999204 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cb309c1-07a8-4368-8f7c-b26be418b3ff None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:09.012319 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc976823-154c-4354-9654-c6d65e33d95d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:09.015096 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bc976823-154c-4354-9654-c6d65e33d95d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:09.043040 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-bc976823-154c-4354-9654-c6d65e33d95d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:09.043040 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:09.043040 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:09.043040 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:09.043040 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:09.043040 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:09.043040 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:09.043040 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:09.043040 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:09.043040 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:09.043040 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:09.043040 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:09.043040 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:09.043040 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:09.043040 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:09.043040 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:09.044773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:09.044773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:09.044773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:09.044773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:09.044773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:09.044773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:09.044773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:09.044773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:09.044773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:09.044773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:09.044773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:09.044773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:09.044773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:09.044773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:09.044773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:09.044773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:09.044773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:09.046451 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:09.046451 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:09.046451 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:09.049923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 252/497] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:09.051312 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc976823-154c-4354-9654-c6d65e33d95d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:09.068113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f585d-ed27-4727-83bc-1df191df9989 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:09.069552 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f585d-ed27-4727-83bc-1df191df9989 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:09.070268 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f585d-ed27-4727-83bc-1df191df9989 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:09.070998 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e53f585d-ed27-4727-83bc-1df191df9989 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:09.072424 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f585d-ed27-4727-83bc-1df191df9989 None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:09.073215 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f585d-ed27-4727-83bc-1df191df9989 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:09.075893 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e53f585d-ed27-4727-83bc-1df191df9989 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:09.090935 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 246/498] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:08 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:09.092923 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f585d-ed27-4727-83bc-1df191df9989 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:09.229225 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc976823-154c-4354-9654-c6d65e33d95d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:09.242050 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:09.248332 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e53f585d-ed27-4727-83bc-1df191df9989 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:09.271952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:09.282946 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9af7e-4f48-49c3-8330-0e22e62c8981 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:09.283932 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9af7e-4f48-49c3-8330-0e22e62c8981 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:09.284431 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9af7e-4f48-49c3-8330-0e22e62c8981 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:09.284876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4be9af7e-4f48-49c3-8330-0e22e62c8981 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:09.285815 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9af7e-4f48-49c3-8330-0e22e62c8981 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:09.286404 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9af7e-4f48-49c3-8330-0e22e62c8981 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:09.288566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4be9af7e-4f48-49c3-8330-0e22e62c8981 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:09.295664 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddb79f-b932-4b5e-aeee-94ce67006fe7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:09.296289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddb79f-b932-4b5e-aeee-94ce67006fe7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:09.296566 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddb79f-b932-4b5e-aeee-94ce67006fe7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:09.296837 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8dddb79f-b932-4b5e-aeee-94ce67006fe7 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:09.297534 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddb79f-b932-4b5e-aeee-94ce67006fe7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:09.297834 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddb79f-b932-4b5e-aeee-94ce67006fe7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:09.299217 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8dddb79f-b932-4b5e-aeee-94ce67006fe7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:09.320736 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 247/499] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 221 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:09.320736 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddb79f-b932-4b5e-aeee-94ce67006fe7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:09.336682 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 253/500] 10.222.0.49 () {56 vars in 1133 bytes} [Sun Aug 21 00:52:09 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:09.337443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9af7e-4f48-49c3-8330-0e22e62c8981 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:09.472775 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8dddb79f-b932-4b5e-aeee-94ce67006fe7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:09.501210 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4be9af7e-4f48-49c3-8330-0e22e62c8981 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:09.521068 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20b65b-af1e-4788-a716-3826b24f7b33 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:09.521747 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20b65b-af1e-4788-a716-3826b24f7b33 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:09.522018 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20b65b-af1e-4788-a716-3826b24f7b33 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:09.522309 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d20b65b-af1e-4788-a716-3826b24f7b33 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:09.537625 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d20b65b-af1e-4788-a716-3826b24f7b33 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:09.539110 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d20b65b-af1e-4788-a716-3826b24f7b33 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:09.555306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-3d20b65b-af1e-4788-a716-3826b24f7b33 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:09.555306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:09.555306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:09.555306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:09.555306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:09.555306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:09.555306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:09.555306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:09.555306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:09.555306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:09.555306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:09.555306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:09.555306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:09.555306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:09.555306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:09.555306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:09.556702 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:09.556702 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:09.556702 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:09.556702 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:09.556702 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:09.556702 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:09.556702 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:09.556702 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:09.556702 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:09.556702 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:09.556702 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:09.556702 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:09.556702 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:09.556702 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:09.556702 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:09.556702 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:09.556702 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:09.558130 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:09.558130 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:09.558130 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:09.558130 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 248/501] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:09.558130 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20b65b-af1e-4788-a716-3826b24f7b33 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:09.571974 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18bc28-40b4-431c-aca3-685eeb4ab28c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:09.573106 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18bc28-40b4-431c-aca3-685eeb4ab28c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:09.573642 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18bc28-40b4-431c-aca3-685eeb4ab28c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:09.574126 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c18bc28-40b4-431c-aca3-685eeb4ab28c None admin] PATH_INFO: `/v3/roles/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:09.575714 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:09.594500 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3c18bc28-40b4-431c-aca3-685eeb4ab28c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:09.603777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-3c18bc28-40b4-431c-aca3-685eeb4ab28c None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:09.603777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:09.603777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:09.603777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:09.603777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:09.603777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:09.603777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:09.603777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:09.603777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:09.603777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:09.603777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:09.603777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:09.603777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:09.603777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:09.603777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:09.603777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:09.604771 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:09.604771 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:09.604771 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:09.604771 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:09.604771 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:09.604771 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:09.604771 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:09.604771 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:09.604771 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:09.604771 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:09.604771 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:09.604771 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:09.604771 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:09.604771 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:09.604771 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:09.604771 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:09.605609 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:09.605609 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:09.605609 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:09.605609 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:09.605609 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:09.605609 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:09.605609 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:09.605609 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:09.605609 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:09.605609 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:09.605609 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:09.605609 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:09.606218 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 254/502] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:09 2022] GET /identity/v3/roles/service => generated 85 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:09.607346 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18bc28-40b4-431c-aca3-685eeb4ab28c None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:09.689364 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:09.704150 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d20b65b-af1e-4788-a716-3826b24f7b33 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:09.750988 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453e2ee-e692-42c1-bc1d-7426c1b917fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:09.752051 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453e2ee-e692-42c1-bc1d-7426c1b917fb None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:09.752522 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453e2ee-e692-42c1-bc1d-7426c1b917fb None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:09.752790 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9453e2ee-e692-42c1-bc1d-7426c1b917fb None admin] PATH_INFO: `/v3/users/glance` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:09.761839 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453e2ee-e692-42c1-bc1d-7426c1b917fb None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:09.763494 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9453e2ee-e692-42c1-bc1d-7426c1b917fb None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:09.772494 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c18bc28-40b4-431c-aca3-685eeb4ab28c None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:09.786872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-9453e2ee-e692-42c1-bc1d-7426c1b917fb None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 21 00:52:09.786872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:09.786872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:09.786872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:09.786872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:09.786872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:09.786872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:09.786872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:09.786872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:09.786872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:09.786872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:09.786872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:09.786872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:09.786872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:09.786872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:09.786872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:09.788869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:09.788869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:09.788869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:09.788869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:09.788869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:09.788869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:09.788869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:09.788869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:09.788869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:09.788869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:09.788869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:09.788869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:09.788869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:09.788869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:09.788869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:09.788869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:09.788869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:09.788869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:09.790982 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:09.790982 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:09.790982 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:09.790982 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:09.790982 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:09.790982 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:09.790982 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:09.790982 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:09.790982 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 21 00:52:09.790982 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:09.790982 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 249/503] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:52:09 2022] GET /identity/v3/users/glance => generated 84 bytes in 232 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:09.792373 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453e2ee-e692-42c1-bc1d-7426c1b917fb None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:09.824643 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e4bbbce-be1c-4a9f-9d7d-aeea44d18e77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:09.825726 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bbbce-be1c-4a9f-9d7d-aeea44d18e77 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:09.826212 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bbbce-be1c-4a9f-9d7d-aeea44d18e77 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:09.826713 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e4bbbce-be1c-4a9f-9d7d-aeea44d18e77 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:09.885560 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:09.932919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bbbce-be1c-4a9f-9d7d-aeea44d18e77 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:09.935530 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e4bbbce-be1c-4a9f-9d7d-aeea44d18e77 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:09.939977 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9453e2ee-e692-42c1-bc1d-7426c1b917fb None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:09.999742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7719925-39d4-43c4-a604-87d3676ee3a9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:10.001287 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7719925-39d4-43c4-a604-87d3676ee3a9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:10.001440 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7719925-39d4-43c4-a604-87d3676ee3a9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:10.001844 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e7719925-39d4-43c4-a604-87d3676ee3a9 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:10.002299 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:10.002923 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7719925-39d4-43c4-a604-87d3676ee3a9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:10.003359 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7719925-39d4-43c4-a604-87d3676ee3a9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:10.005460 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e7719925-39d4-43c4-a604-87d3676ee3a9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:10.022359 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 250/504] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:09 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 232 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:10.023448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7719925-39d4-43c4-a604-87d3676ee3a9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:10.084060 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 255/505] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:09 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:52:10.084060 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1435c-f06d-4181-9f1a-7be62301aed6 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:10.084060 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1435c-f06d-4181-9f1a-7be62301aed6 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:10.084060 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8d1435c-f06d-4181-9f1a-7be62301aed6 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:10.084060 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 256/506] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:10 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:10.084595 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1435c-f06d-4181-9f1a-7be62301aed6 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:10.159272 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e7719925-39d4-43c4-a604-87d3676ee3a9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:10.191644 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:10.199287 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c235c-c94a-45c7-8605-7c0b437e2017 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:10.200145 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c235c-c94a-45c7-8605-7c0b437e2017 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:10.200527 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c235c-c94a-45c7-8605-7c0b437e2017 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:10.200901 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df5c235c-c94a-45c7-8605-7c0b437e2017 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:10.201932 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c235c-c94a-45c7-8605-7c0b437e2017 None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:10.202354 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c235c-c94a-45c7-8605-7c0b437e2017 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:10.204415 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df5c235c-c94a-45c7-8605-7c0b437e2017 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:10.220640 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 251/507] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:10.221900 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c235c-c94a-45c7-8605-7c0b437e2017 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:10.266822 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8d1435c-f06d-4181-9f1a-7be62301aed6 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:10.317860 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299681f-f40a-422c-81c1-e4e2b989df55 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:10.318817 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299681f-f40a-422c-81c1-e4e2b989df55 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:10.319261 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299681f-f40a-422c-81c1-e4e2b989df55 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:10.319697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0299681f-f40a-422c-81c1-e4e2b989df55 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:10.320940 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299681f-f40a-422c-81c1-e4e2b989df55 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:10.321468 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299681f-f40a-422c-81c1-e4e2b989df55 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:10.324556 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0299681f-f40a-422c-81c1-e4e2b989df55 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:10.356699 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 257/508] 10.222.0.49 () {56 vars in 1137 bytes} [Sun Aug 21 00:52:10 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 273 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:10.358126 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299681f-f40a-422c-81c1-e4e2b989df55 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:10.365470 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:10.382906 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df5c235c-c94a-45c7-8605-7c0b437e2017 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:10.448709 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-789d2951-7901-44bd-a23c-f4e10c4a507c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:10.449832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d2951-7901-44bd-a23c-f4e10c4a507c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:10.450338 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d2951-7901-44bd-a23c-f4e10c4a507c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:10.450832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-789d2951-7901-44bd-a23c-f4e10c4a507c None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:10.465610 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d2951-7901-44bd-a23c-f4e10c4a507c None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:10.468373 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-789d2951-7901-44bd-a23c-f4e10c4a507c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:10.491000 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-789d2951-7901-44bd-a23c-f4e10c4a507c None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 00:52:10.491000 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:10.491000 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:10.491000 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:10.491000 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:10.491000 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:10.491000 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:10.491000 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:10.491000 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:10.491000 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:10.491000 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:10.491000 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:10.491000 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:10.491000 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:10.491000 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:10.491000 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:10.492262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:10.492262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:10.492262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:10.492262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:10.492262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:10.492262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:10.492262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:10.492262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:10.492262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:10.492262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:10.492262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:10.492262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:10.492262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:10.492262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:10.492262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:10.492262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:10.492262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:10.492262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:10.493912 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:10.493912 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:10.493912 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:10.493912 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:10.493912 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:10.493912 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:10.493912 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:10.493912 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:10.493912 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 00:52:10.493912 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:10.493912 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 252/509] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:52:10 2022] GET /identity/v3/users/cinder => generated 84 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:10.495463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a09404-5bbd-479f-98a6-e40e57c57ba7 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:10.495978 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a09404-5bbd-479f-98a6-e40e57c57ba7 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:10.496478 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9a09404-5bbd-479f-98a6-e40e57c57ba7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:10.528841 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e9a09404-5bbd-479f-98a6-e40e57c57ba7 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:10.530899 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e9a09404-5bbd-479f-98a6-e40e57c57ba7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:10.555059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0299681f-f40a-422c-81c1-e4e2b989df55 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:10.611624 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:10.623617 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f18269-5471-456f-bbff-a59622709678 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:10.624500 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f18269-5471-456f-bbff-a59622709678 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:10.624871 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f18269-5471-456f-bbff-a59622709678 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:10.625618 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2f18269-5471-456f-bbff-a59622709678 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:10.639646 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 253/510] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:10 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:10.641013 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a09404-5bbd-479f-98a6-e40e57c57ba7 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:10.648129 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f18269-5471-456f-bbff-a59622709678 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:10.650563 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2f18269-5471-456f-bbff-a59622709678 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:10.678238 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-a2f18269-5471-456f-bbff-a59622709678 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:10.678238 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:10.678238 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:10.678238 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:10.678238 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:10.678238 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:10.678238 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:10.678238 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:10.678238 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:10.678238 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:10.678238 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:10.678238 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:10.678238 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:10.678238 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:10.678238 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:10.678238 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:10.679661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:10.679661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:10.679661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:10.679661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:10.679661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:10.679661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:10.679661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:10.679661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:10.679661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:10.679661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:10.679661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:10.679661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:10.679661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:10.679661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:10.679661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:10.679661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:10.679661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:10.680953 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:10.680953 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:10.680953 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:10.680953 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 258/511] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:10.681987 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f18269-5471-456f-bbff-a59622709678 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:10.796226 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:10.831909 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9a09404-5bbd-479f-98a6-e40e57c57ba7 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:10.884865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2f18269-5471-456f-bbff-a59622709678 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:10.902476 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25234649-f0fc-4616-8226-a9a915849bdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:10.903942 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25234649-f0fc-4616-8226-a9a915849bdb None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:10.904439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25234649-f0fc-4616-8226-a9a915849bdb None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:10.904928 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25234649-f0fc-4616-8226-a9a915849bdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:10.929943 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25234649-f0fc-4616-8226-a9a915849bdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:10.934251 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-25234649-f0fc-4616-8226-a9a915849bdb None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:10.942297 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e235b3-116a-4dc1-8ee2-b1ba079f3ef6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:10.943409 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e235b3-116a-4dc1-8ee2-b1ba079f3ef6 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:10.943924 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e235b3-116a-4dc1-8ee2-b1ba079f3ef6 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:10.944406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1e235b3-116a-4dc1-8ee2-b1ba079f3ef6 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:10.959192 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-25234649-f0fc-4616-8226-a9a915849bdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:10.959192 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:10.959192 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:10.959192 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:10.959192 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:10.959192 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:10.959192 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:10.959192 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:10.959192 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:10.959192 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:10.959192 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:10.959192 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:10.959192 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:10.959192 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:10.959192 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:10.959192 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:10.969415 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:10.969415 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:10.969415 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:10.969415 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:10.969415 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:10.969415 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:10.969415 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:10.969415 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:10.969415 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:10.969415 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:10.969415 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:10.969415 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:10.969415 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:10.969415 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:10.969415 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:10.969415 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:10.969415 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:10.971361 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:10.971361 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:10.971361 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:10.971361 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 254/512] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 321 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:10.971361 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25234649-f0fc-4616-8226-a9a915849bdb None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:11.026828 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:11.086136 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e235b3-116a-4dc1-8ee2-b1ba079f3ef6 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:11.088976 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1e235b3-116a-4dc1-8ee2-b1ba079f3ef6 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:11.143844 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-25234649-f0fc-4616-8226-a9a915849bdb None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:11.185541 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:11.210533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2dc4d6-5d39-41b2-acf1-8a1634cb9f03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:11.211477 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dc4d6-5d39-41b2-acf1-8a1634cb9f03 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:11.211933 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dc4d6-5d39-41b2-acf1-8a1634cb9f03 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:11.212304 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be2dc4d6-5d39-41b2-acf1-8a1634cb9f03 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:11.213438 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2dc4d6-5d39-41b2-acf1-8a1634cb9f03 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:11.213863 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2dc4d6-5d39-41b2-acf1-8a1634cb9f03 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:11.216067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be2dc4d6-5d39-41b2-acf1-8a1634cb9f03 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:11.275220 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 255/513] 10.222.0.49 () {56 vars in 1137 bytes} [Sun Aug 21 00:52:10 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:11.276413 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2dc4d6-5d39-41b2-acf1-8a1634cb9f03 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:11.276729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 259/514] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:10 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 596 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:52:11.278507 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e235b3-116a-4dc1-8ee2-b1ba079f3ef6 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:11.446127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1e235b3-116a-4dc1-8ee2-b1ba079f3ef6 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:11.457247 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:11.470123 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be2dc4d6-5d39-41b2-acf1-8a1634cb9f03 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:11.504873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e302aa2-66d5-474e-a80b-ea00baead01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:11.505959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e302aa2-66d5-474e-a80b-ea00baead01f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:11.506450 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e302aa2-66d5-474e-a80b-ea00baead01f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:11.506936 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e302aa2-66d5-474e-a80b-ea00baead01f None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:11.508120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e302aa2-66d5-474e-a80b-ea00baead01f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:11.508670 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e302aa2-66d5-474e-a80b-ea00baead01f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:11.511441 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e302aa2-66d5-474e-a80b-ea00baead01f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:11.531171 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f794847-16a1-495e-bbb6-9bc711745cf5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:11.532019 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f794847-16a1-495e-bbb6-9bc711745cf5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:11.532400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f794847-16a1-495e-bbb6-9bc711745cf5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:11.532768 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f794847-16a1-495e-bbb6-9bc711745cf5 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:11.533737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f794847-16a1-495e-bbb6-9bc711745cf5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:11.534157 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f794847-16a1-495e-bbb6-9bc711745cf5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:11.534783 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 260/515] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 257 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:11.536028 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e302aa2-66d5-474e-a80b-ea00baead01f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:11.536195 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f794847-16a1-495e-bbb6-9bc711745cf5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:11.554070 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 256/516] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:11.555880 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f794847-16a1-495e-bbb6-9bc711745cf5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:11.579613 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:11.686688 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f794847-16a1-495e-bbb6-9bc711745cf5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:11.705822 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e302aa2-66d5-474e-a80b-ea00baead01f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:11.739039 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9c0d1-66b3-4141-88ef-624953404ef1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:11.739656 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9c0d1-66b3-4141-88ef-624953404ef1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:11.739934 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9c0d1-66b3-4141-88ef-624953404ef1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:11.740207 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eae9c0d1-66b3-4141-88ef-624953404ef1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:11.752830 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780643b5-745d-4539-8861-bfcde8da3482 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:11.753804 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780643b5-745d-4539-8861-bfcde8da3482 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:11.754083 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780643b5-745d-4539-8861-bfcde8da3482 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:11.754444 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-780643b5-745d-4539-8861-bfcde8da3482 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:11.769882 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:11.771616 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780643b5-745d-4539-8861-bfcde8da3482 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:11.773491 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-780643b5-745d-4539-8861-bfcde8da3482 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:11.789152 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-780643b5-745d-4539-8861-bfcde8da3482 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:11.789152 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:11.789152 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:11.789152 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:11.789152 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:11.789152 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:11.789152 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:11.789152 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:11.789152 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:11.789152 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:11.789152 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:11.789152 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:11.789152 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:11.789152 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:11.789152 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:11.789152 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:11.792870 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:11.792870 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:11.792870 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:11.792870 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:11.792870 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:11.792870 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:11.792870 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:11.792870 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:11.792870 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:11.792870 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:11.792870 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:11.792870 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:11.792870 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:11.792870 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:11.792870 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:11.792870 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:11.792870 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:11.794020 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:11.794020 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:11.794020 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:11.794020 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 261/517] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 255 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:11.794020 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780643b5-745d-4539-8861-bfcde8da3482 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:11.826792 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9c0d1-66b3-4141-88ef-624953404ef1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:11.828928 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eae9c0d1-66b3-4141-88ef-624953404ef1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:11.881513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:11.926818 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-780643b5-745d-4539-8861-bfcde8da3482 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:11.958493 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 257/518] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:11 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 404 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:52:11.959255 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9c0d1-66b3-4141-88ef-624953404ef1 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:11.984852 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23230f66-adfb-4ac3-9916-5a8ef90a6d31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:11.985990 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23230f66-adfb-4ac3-9916-5a8ef90a6d31 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:11.986479 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23230f66-adfb-4ac3-9916-5a8ef90a6d31 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:11.986993 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23230f66-adfb-4ac3-9916-5a8ef90a6d31 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:12.006534 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23230f66-adfb-4ac3-9916-5a8ef90a6d31 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:12.009363 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23230f66-adfb-4ac3-9916-5a8ef90a6d31 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:12.028171 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-23230f66-adfb-4ac3-9916-5a8ef90a6d31 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:12.028171 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:12.028171 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:12.028171 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:12.028171 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:12.028171 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:12.028171 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:12.028171 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:12.028171 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:12.028171 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:12.028171 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:12.028171 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:12.028171 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:12.028171 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:12.028171 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:12.028171 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:12.029805 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:12.029805 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:12.029805 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:12.029805 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:12.029805 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:12.029805 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:12.029805 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:12.029805 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:12.029805 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:12.029805 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:12.029805 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:12.029805 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:12.029805 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:12.029805 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:12.029805 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:12.029805 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:12.029805 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:12.031441 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:12.031441 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:12.031441 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:12.031441 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 262/519] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 238 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:12.031441 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23230f66-adfb-4ac3-9916-5a8ef90a6d31 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:12.074927 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:12.150621 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eae9c0d1-66b3-4141-88ef-624953404ef1 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:12.168520 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23230f66-adfb-4ac3-9916-5a8ef90a6d31 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:12.203560 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:12.223220 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085c7e1-010a-4650-8254-475487216f00 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:12.223878 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085c7e1-010a-4650-8254-475487216f00 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:12.224194 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085c7e1-010a-4650-8254-475487216f00 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:12.224504 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8085c7e1-010a-4650-8254-475487216f00 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:12.232284 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001385a6-fed9-468e-b14e-0c72a8940a7a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:12.233400 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001385a6-fed9-468e-b14e-0c72a8940a7a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:12.233502 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001385a6-fed9-468e-b14e-0c72a8940a7a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:12.233759 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001385a6-fed9-468e-b14e-0c72a8940a7a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:12.237742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085c7e1-010a-4650-8254-475487216f00 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:12.240511 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8085c7e1-010a-4650-8254-475487216f00 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:12.242788 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001385a6-fed9-468e-b14e-0c72a8940a7a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:12.244396 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001385a6-fed9-468e-b14e-0c72a8940a7a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:12.258674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-001385a6-fed9-468e-b14e-0c72a8940a7a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:12.258674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:12.258674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:12.258674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:12.258674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:12.258674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:12.258674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:12.258674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:12.258674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:12.258674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:12.258674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:12.258674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:12.258674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:12.258674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:12.258674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:12.260180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:12.260180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:12.260180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:12.260180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:12.260180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:12.260180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:12.260180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:12.260180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:12.260180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:12.260180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:12.260180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:12.260180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:12.260180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:12.260180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:12.260180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:12.260180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:12.260180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:12.261732 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:12.261732 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:12.261732 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:12.261732 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:12.261732 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:12.261732 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:12.261732 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:12.261732 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:12.261732 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 263/520] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:12 2022] GET /identity/v3/projects/service => generated 88 bytes in 230 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:12.261732 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001385a6-fed9-468e-b14e-0c72a8940a7a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:12.266968 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-8085c7e1-010a-4650-8254-475487216f00 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 21 00:52:12.266968 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:12.266968 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:12.266968 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:12.266968 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:12.266968 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:12.266968 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:12.266968 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:12.266968 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:12.266968 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:12.266968 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:12.266968 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:12.266968 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:12.266968 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:12.266968 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:12.266968 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:12.268662 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:12.268662 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:12.268662 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:12.268662 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:12.268662 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:12.268662 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:12.268662 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:12.268662 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:12.268662 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:12.268662 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:12.268662 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:12.268662 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:12.268662 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:12.268662 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:12.268662 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:12.268662 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:12.268662 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:12.268662 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:12.271616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:12.271616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:12.271616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:12.271616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:12.271616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:12.271616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:12.271616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:12.271616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:12.271616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 21 00:52:12.271616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:12.271616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 258/521] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:11 2022] GET /identity/v3/users/neutron => generated 85 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:12.271616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085c7e1-010a-4650-8254-475487216f00 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:12.410767 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8085c7e1-010a-4650-8254-475487216f00 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:12.415209 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001385a6-fed9-468e-b14e-0c72a8940a7a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:12.435293 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:12.469075 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342992ae-ec48-4ba2-baa0-ef69375e498a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:12.470093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342992ae-ec48-4ba2-baa0-ef69375e498a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:12.470569 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342992ae-ec48-4ba2-baa0-ef69375e498a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:12.471088 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-342992ae-ec48-4ba2-baa0-ef69375e498a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:12.477142 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c640a0-d44d-44d8-b595-9c6d39419c75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:12.478117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c640a0-d44d-44d8-b595-9c6d39419c75 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:12.478612 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c640a0-d44d-44d8-b595-9c6d39419c75 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:12.479108 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0c640a0-d44d-44d8-b595-9c6d39419c75 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:12.480304 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c640a0-d44d-44d8-b595-9c6d39419c75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:12.480835 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c640a0-d44d-44d8-b595-9c6d39419c75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:12.483664 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0c640a0-d44d-44d8-b595-9c6d39419c75 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:12.488454 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342992ae-ec48-4ba2-baa0-ef69375e498a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:12.491143 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-342992ae-ec48-4ba2-baa0-ef69375e498a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:12.505995 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 264/522] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 246 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:12.507529 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c640a0-d44d-44d8-b595-9c6d39419c75 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:12.514035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-342992ae-ec48-4ba2-baa0-ef69375e498a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:12.514035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:12.514035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:12.514035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:12.514035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:12.514035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:12.514035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:12.514035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:12.514035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:12.514035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:12.514035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:12.514035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:12.514035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:12.514035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:12.514035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:12.514035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:12.515439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:12.515439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:12.515439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:12.515439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:12.515439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:12.515439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:12.515439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:12.515439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:12.515439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:12.515439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:12.515439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:12.515439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:12.515439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:12.515439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:12.515439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:12.515439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:12.515439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:12.516817 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:12.516817 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:12.516817 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:12.516817 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 259/523] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 247 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:12.517157 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342992ae-ec48-4ba2-baa0-ef69375e498a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:12.584825 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:12.659657 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-342992ae-ec48-4ba2-baa0-ef69375e498a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:12.690853 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0c640a0-d44d-44d8-b595-9c6d39419c75 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:12.741753 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a29eb-e221-4401-a2ed-7cd68191dca3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:12.741990 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4be61a-3bce-415e-82fc-f204bf25fa09 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:12.742490 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4be61a-3bce-415e-82fc-f204bf25fa09 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:12.742688 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a29eb-e221-4401-a2ed-7cd68191dca3 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:12.742870 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4be61a-3bce-415e-82fc-f204bf25fa09 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:12.743023 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a29eb-e221-4401-a2ed-7cd68191dca3 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:12.743279 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f4be61a-3bce-415e-82fc-f204bf25fa09 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:12.743409 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb4a29eb-e221-4401-a2ed-7cd68191dca3 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:12.744395 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4be61a-3bce-415e-82fc-f204bf25fa09 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:12.744526 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a29eb-e221-4401-a2ed-7cd68191dca3 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:12.744805 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4be61a-3bce-415e-82fc-f204bf25fa09 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:12.745082 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a29eb-e221-4401-a2ed-7cd68191dca3 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:12.746555 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f4be61a-3bce-415e-82fc-f204bf25fa09 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:12.747516 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb4a29eb-e221-4401-a2ed-7cd68191dca3 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:12.766628 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 265/524] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 260 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:12.768259 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a29eb-e221-4401-a2ed-7cd68191dca3 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:12.777652 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 260/525] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:12 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:12.778981 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4be61a-3bce-415e-82fc-f204bf25fa09 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:12.813732 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:12.903943 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f4be61a-3bce-415e-82fc-f204bf25fa09 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:12.932503 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:12.937781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb4a29eb-e221-4401-a2ed-7cd68191dca3 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:12.945355 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382cbe3-2eb3-4899-a136-6f987f78fc0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:12.946267 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382cbe3-2eb3-4899-a136-6f987f78fc0f None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:12.946743 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382cbe3-2eb3-4899-a136-6f987f78fc0f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:12.947186 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9382cbe3-2eb3-4899-a136-6f987f78fc0f None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:12.948417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382cbe3-2eb3-4899-a136-6f987f78fc0f None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:12.950443 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9382cbe3-2eb3-4899-a136-6f987f78fc0f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:12.993435 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 261/526] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 21 00:52:12 2022] POST /identity/v3/users => generated 247 bytes in 215 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:52:12.994544 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382cbe3-2eb3-4899-a136-6f987f78fc0f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:13.014103 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf266866-ba75-440c-ae1d-1fea3ee63637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:13.014878 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf266866-ba75-440c-ae1d-1fea3ee63637 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:13.016689 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf266866-ba75-440c-ae1d-1fea3ee63637 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:13.017113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf266866-ba75-440c-ae1d-1fea3ee63637 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:13.018084 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf266866-ba75-440c-ae1d-1fea3ee63637 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:13.018465 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf266866-ba75-440c-ae1d-1fea3ee63637 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:13.020263 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf266866-ba75-440c-ae1d-1fea3ee63637 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:13.051090 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 266/527] 10.222.0.49 () {56 vars in 1139 bytes} [Sun Aug 21 00:52:12 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:13.052454 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf266866-ba75-440c-ae1d-1fea3ee63637 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:13.129084 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:13.165974 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9382cbe3-2eb3-4899-a136-6f987f78fc0f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:13.211497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf266866-ba75-440c-ae1d-1fea3ee63637 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:13.236078 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9cb71-aea0-4db8-9516-fbae4d86b8cd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:13.237157 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9cb71-aea0-4db8-9516-fbae4d86b8cd None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:13.237639 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9cb71-aea0-4db8-9516-fbae4d86b8cd None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:13.238089 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76f9cb71-aea0-4db8-9516-fbae4d86b8cd None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:13.239334 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9cb71-aea0-4db8-9516-fbae4d86b8cd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:13.239954 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9cb71-aea0-4db8-9516-fbae4d86b8cd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:13.242463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76f9cb71-aea0-4db8-9516-fbae4d86b8cd None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:13.260545 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 262/528] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:12 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:13.261495 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9cb71-aea0-4db8-9516-fbae4d86b8cd None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:13.265837 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc5023-778f-4d1d-bf91-62e0756f39b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:13.267073 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc5023-778f-4d1d-bf91-62e0756f39b2 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:13.267548 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc5023-778f-4d1d-bf91-62e0756f39b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:13.268311 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49fc5023-778f-4d1d-bf91-62e0756f39b2 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:13.281394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc5023-778f-4d1d-bf91-62e0756f39b2 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:13.283184 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49fc5023-778f-4d1d-bf91-62e0756f39b2 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:13.298847 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-49fc5023-778f-4d1d-bf91-62e0756f39b2 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:13.298847 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:13.298847 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:13.298847 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:13.298847 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:13.298847 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:13.298847 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:13.298847 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:13.298847 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:13.298847 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:13.298847 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:13.298847 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:13.298847 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:13.298847 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:13.298847 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:13.300466 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:13.300466 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:13.300466 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:13.300466 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:13.300466 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:13.300466 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:13.300466 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:13.300466 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:13.300466 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:13.300466 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:13.300466 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:13.300466 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:13.300466 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:13.300466 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:13.300466 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:13.300466 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:13.300466 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:13.302106 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:13.302106 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:13.302106 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:13.302106 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:13.302106 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:13.302106 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:13.302106 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:13.302106 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:13.302106 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 267/529] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 249 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:13.302106 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc5023-778f-4d1d-bf91-62e0756f39b2 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:13.333289 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:13.432561 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76f9cb71-aea0-4db8-9516-fbae4d86b8cd None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:13.479765 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49fc5023-778f-4d1d-bf91-62e0756f39b2 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:13.497610 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9048ebc-1c62-4d48-b443-ee79c2ab0c7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:13.498938 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9048ebc-1c62-4d48-b443-ee79c2ab0c7d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:13.499819 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9048ebc-1c62-4d48-b443-ee79c2ab0c7d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:13.500817 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f9048ebc-1c62-4d48-b443-ee79c2ab0c7d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:13.502971 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9048ebc-1c62-4d48-b443-ee79c2ab0c7d None admin] RBAC: Adding query filter params (role.id=b549ba322af24099825f8949d2060adf, scope.project.id=838e996d09a0454b9bcdc5aef03ef203, user.id=6b003ae4a082485ab608bf84c1657159) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:13.503974 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9048ebc-1c62-4d48-b443-ee79c2ab0c7d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:13.507518 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f9048ebc-1c62-4d48-b443-ee79c2ab0c7d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:13.525194 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 263/530] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:13 2022] GET /identity/v3/role_assignments?user.id=6b003ae4a082485ab608bf84c1657159&scope.project.id=838e996d09a0454b9bcdc5aef03ef203&role.id=b549ba322af24099825f8949d2060adf => generated 259 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:13.525194 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9048ebc-1c62-4d48-b443-ee79c2ab0c7d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:13.534892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:13.552571 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0543e-b9ca-4fdf-9d6f-7cac8394014b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:13.553785 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0543e-b9ca-4fdf-9d6f-7cac8394014b None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:13.554233 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0543e-b9ca-4fdf-9d6f-7cac8394014b None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:13.554779 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83f0543e-b9ca-4fdf-9d6f-7cac8394014b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:13.717031 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0543e-b9ca-4fdf-9d6f-7cac8394014b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:13.718963 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83f0543e-b9ca-4fdf-9d6f-7cac8394014b None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:13.742246 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f9048ebc-1c62-4d48-b443-ee79c2ab0c7d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:13.747941 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:13.803105 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac2e47-5656-4236-8c22-8d52b9bb377d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:13.804355 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac2e47-5656-4236-8c22-8d52b9bb377d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:13.804832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac2e47-5656-4236-8c22-8d52b9bb377d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:13.805318 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cac2e47-5656-4236-8c22-8d52b9bb377d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:13.815341 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac2e47-5656-4236-8c22-8d52b9bb377d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:13.817208 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3cac2e47-5656-4236-8c22-8d52b9bb377d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:13.839091 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-3cac2e47-5656-4236-8c22-8d52b9bb377d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:13.839091 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:13.839091 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:13.839091 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:13.839091 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:13.839091 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:13.839091 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:13.839091 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:13.839091 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:13.839091 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:13.839091 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:13.839091 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:13.839091 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:13.839091 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:13.839091 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:13.840011 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:13.840011 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:13.840011 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:13.840011 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:13.840011 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:13.840011 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:13.840011 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:13.840011 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:13.840011 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:13.840011 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:13.840011 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:13.840011 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:13.840011 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:13.840011 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:13.840011 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:13.840011 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:13.840011 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:13.840846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:13.840846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:13.840846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:13.840846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:13.840846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:13.840846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:13.840846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:13.840846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:13.841286 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 264/531] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:13.842040 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac2e47-5656-4236-8c22-8d52b9bb377d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:13.892866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 268/532] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:13 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 592 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:52:13.894102 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0543e-b9ca-4fdf-9d6f-7cac8394014b None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:13.985455 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:14.025905 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cac2e47-5656-4236-8c22-8d52b9bb377d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:14.082520 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfc162-e138-4f83-a5c9-97871240a14b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:14.083050 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfc162-e138-4f83-a5c9-97871240a14b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:14.083326 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfc162-e138-4f83-a5c9-97871240a14b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:14.083594 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d8cfc162-e138-4f83-a5c9-97871240a14b None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:14.084304 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfc162-e138-4f83-a5c9-97871240a14b None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:14.084602 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfc162-e138-4f83-a5c9-97871240a14b None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:14.085523 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83f0543e-b9ca-4fdf-9d6f-7cac8394014b None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:14.086208 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d8cfc162-e138-4f83-a5c9-97871240a14b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:14.102231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 265/533] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:14.103134 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfc162-e138-4f83-a5c9-97871240a14b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:14.114729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:14.144076 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645276f9-2948-426f-bf3c-606b775af9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:14.145008 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645276f9-2948-426f-bf3c-606b775af9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:14.146478 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645276f9-2948-426f-bf3c-606b775af9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:14.146478 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-645276f9-2948-426f-bf3c-606b775af9f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:14.147842 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645276f9-2948-426f-bf3c-606b775af9f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:14.148494 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645276f9-2948-426f-bf3c-606b775af9f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:14.151568 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-645276f9-2948-426f-bf3c-606b775af9f4 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:14.193781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 269/534] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:14.195511 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645276f9-2948-426f-bf3c-606b775af9f4 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:14.251616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d8cfc162-e138-4f83-a5c9-97871240a14b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:14.294161 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:14.308113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc90af9-4540-4d70-a322-018d6f181bbe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:14.309475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc90af9-4540-4d70-a322-018d6f181bbe None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:14.310246 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc90af9-4540-4d70-a322-018d6f181bbe None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:14.310876 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3fc90af9-4540-4d70-a322-018d6f181bbe None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:14.327506 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc90af9-4540-4d70-a322-018d6f181bbe None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:14.330215 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3fc90af9-4540-4d70-a322-018d6f181bbe None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:14.345455 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-645276f9-2948-426f-bf3c-606b775af9f4 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:14.355309 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-3fc90af9-4540-4d70-a322-018d6f181bbe None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:14.355309 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:14.355309 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:14.355309 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:14.355309 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:14.355309 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:14.355309 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:14.355309 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:14.355309 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:14.355309 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:14.355309 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:14.355309 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:14.355309 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:14.355309 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:14.355309 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:14.355309 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:14.356700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:14.356700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:14.356700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:14.356700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:14.356700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:14.356700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:14.356700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:14.356700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:14.356700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:14.356700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:14.356700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:14.356700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:14.356700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:14.356700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:14.356700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:14.356700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:14.356700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:14.358029 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:14.358029 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:14.358029 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:14.365190 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 266/535] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:14 2022] GET /identity/v3/domains/Default => generated 87 bytes in 258 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:14.366881 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc90af9-4540-4d70-a322-018d6f181bbe None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:14.405737 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc0539-e5ff-42f3-ba73-afe27c0a8e04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:14.406729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc0539-e5ff-42f3-ba73-afe27c0a8e04 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:14.407639 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc0539-e5ff-42f3-ba73-afe27c0a8e04 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:14.407776 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47dc0539-e5ff-42f3-ba73-afe27c0a8e04 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:14.409169 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc0539-e5ff-42f3-ba73-afe27c0a8e04 None admin] RBAC: Adding query filter params (role.id=b549ba322af24099825f8949d2060adf, scope.project.id=838e996d09a0454b9bcdc5aef03ef203, user.id=77362a2134af4ede855882c58f40c472) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:14.409736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc0539-e5ff-42f3-ba73-afe27c0a8e04 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:14.412453 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-47dc0539-e5ff-42f3-ba73-afe27c0a8e04 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:14.423417 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 270/536] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:14 2022] GET /identity/v3/role_assignments?user.id=77362a2134af4ede855882c58f40c472&scope.project.id=838e996d09a0454b9bcdc5aef03ef203&role.id=b549ba322af24099825f8949d2060adf => generated 259 bytes in 229 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:14.424884 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc0539-e5ff-42f3-ba73-afe27c0a8e04 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:14.500994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:14.539791 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3fc90af9-4540-4d70-a322-018d6f181bbe None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:14.571803 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-47dc0539-e5ff-42f3-ba73-afe27c0a8e04 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:14.595875 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3b982-65d4-471c-ae38-d624435dcc62 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:14.597272 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3b982-65d4-471c-ae38-d624435dcc62 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:14.598083 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3b982-65d4-471c-ae38-d624435dcc62 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:14.598870 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3d3b982-65d4-471c-ae38-d624435dcc62 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:14.600253 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3b982-65d4-471c-ae38-d624435dcc62 None admin] RBAC: Adding query filter params (role.id=b549ba322af24099825f8949d2060adf, scope.project.id=838e996d09a0454b9bcdc5aef03ef203, user.id=67305d6f08d64f8ba39abe10bd4974c9) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:14.600954 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3b982-65d4-471c-ae38-d624435dcc62 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:14.603595 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3d3b982-65d4-471c-ae38-d624435dcc62 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:14.610896 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd081e2-7529-493b-9f5f-f80306c4c4a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:14.611432 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd081e2-7529-493b-9f5f-f80306c4c4a5 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:14.611708 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd081e2-7529-493b-9f5f-f80306c4c4a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:14.611981 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdd081e2-7529-493b-9f5f-f80306c4c4a5 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:14.612637 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd081e2-7529-493b-9f5f-f80306c4c4a5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:14.612935 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd081e2-7529-493b-9f5f-f80306c4c4a5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:14.614530 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdd081e2-7529-493b-9f5f-f80306c4c4a5 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:14.616078 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 267/537] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:14 2022] GET /identity/v3/role_assignments?user.id=67305d6f08d64f8ba39abe10bd4974c9&scope.project.id=838e996d09a0454b9bcdc5aef03ef203&role.id=b549ba322af24099825f8949d2060adf => generated 259 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:14.637721 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 271/538] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:14 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:14.647120 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3b982-65d4-471c-ae38-d624435dcc62 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:14.748823 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:14.896874 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3d3b982-65d4-471c-ae38-d624435dcc62 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:14.959659 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fa468-1a0d-41f6-85b1-8cca84feaf5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:14.960708 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fa468-1a0d-41f6-85b1-8cca84feaf5c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:14.961216 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fa468-1a0d-41f6-85b1-8cca84feaf5c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:14.961684 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e85fa468-1a0d-41f6-85b1-8cca84feaf5c None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:14.974907 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fa468-1a0d-41f6-85b1-8cca84feaf5c None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:14.977831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e85fa468-1a0d-41f6-85b1-8cca84feaf5c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:14.999867 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-e85fa468-1a0d-41f6-85b1-8cca84feaf5c None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:14.999867 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:14.999867 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:14.999867 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:14.999867 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:14.999867 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:14.999867 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:14.999867 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:14.999867 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:14.999867 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:14.999867 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:14.999867 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:14.999867 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:14.999867 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:14.999867 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:15.001821 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:15.001821 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:15.001821 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:15.001821 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:15.001821 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:15.001821 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:15.001821 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:15.001821 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:15.001821 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:15.001821 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:15.001821 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:15.001821 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:15.001821 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:15.001821 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:15.001821 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:15.001821 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:15.001821 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:15.003386 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:15.003386 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:15.003386 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:15.003386 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:15.003386 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:15.003386 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:15.003386 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:15.003386 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:15.003386 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 268/539] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:15.011371 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd081e2-7529-493b-9f5f-f80306c4c4a5 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:15.356841 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdd081e2-7529-493b-9f5f-f80306c4c4a5 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:15.359843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:15.417293 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-021410f6-d9b9-4384-8385-ba1fc37876e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:15.417917 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021410f6-d9b9-4384-8385-ba1fc37876e5 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:15.418194 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021410f6-d9b9-4384-8385-ba1fc37876e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:15.418464 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-021410f6-d9b9-4384-8385-ba1fc37876e5 None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:15.419167 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021410f6-d9b9-4384-8385-ba1fc37876e5 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:15.419466 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021410f6-d9b9-4384-8385-ba1fc37876e5 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:15.420926 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-021410f6-d9b9-4384-8385-ba1fc37876e5 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:15.434390 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 272/540] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:15 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 424 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:15.443554 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fa468-1a0d-41f6-85b1-8cca84feaf5c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:15.692086 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e85fa468-1a0d-41f6-85b1-8cca84feaf5c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:15.697625 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:15.775166 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9469df77-f395-4175-8aff-18017ba0cba6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:15.776306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469df77-f395-4175-8aff-18017ba0cba6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:15.776882 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469df77-f395-4175-8aff-18017ba0cba6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:15.777412 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9469df77-f395-4175-8aff-18017ba0cba6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:15.778998 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469df77-f395-4175-8aff-18017ba0cba6 None admin] RBAC: Adding query filter params (role.id=b549ba322af24099825f8949d2060adf, scope.project.id=838e996d09a0454b9bcdc5aef03ef203, user.id=78c29816db2d4193b293a0f94b4d1a01) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:15.779524 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469df77-f395-4175-8aff-18017ba0cba6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:15.782292 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9469df77-f395-4175-8aff-18017ba0cba6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:15.793303 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 269/541] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:15 2022] GET /identity/v3/role_assignments?user.id=78c29816db2d4193b293a0f94b4d1a01&scope.project.id=838e996d09a0454b9bcdc5aef03ef203&role.id=b549ba322af24099825f8949d2060adf => generated 259 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:16.104155 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76377906-1fec-4591-8ca4-e7dd56a611ac None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:16.104639 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76377906-1fec-4591-8ca4-e7dd56a611ac None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:16.105182 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76377906-1fec-4591-8ca4-e7dd56a611ac None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:16.108039 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 273/542] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:16.115405 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbadeed-e934-4ec5-86a3-d7d6d7811582 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:16.115751 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbadeed-e934-4ec5-86a3-d7d6d7811582 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:16.115964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7dbadeed-e934-4ec5-86a3-d7d6d7811582 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:16.147003 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-7dbadeed-e934-4ec5-86a3-d7d6d7811582 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:16.148279 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7dbadeed-e934-4ec5-86a3-d7d6d7811582 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:16.319428 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 270/543] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:16.640669 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e367b-78e4-458a-b267-95bfd4b76fb7 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:16.641436 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e367b-78e4-458a-b267-95bfd4b76fb7 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:16.641790 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c16e367b-78e4-458a-b267-95bfd4b76fb7 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:16.644661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 274/544] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:16 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:16.653296 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cf4a1-2b92-4268-8993-1f271d27aaea None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:16.654027 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cf4a1-2b92-4268-8993-1f271d27aaea None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:16.654303 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-093cf4a1-2b92-4268-8993-1f271d27aaea None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:16.695335 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-093cf4a1-2b92-4268-8993-1f271d27aaea None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:16.697557 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-093cf4a1-2b92-4268-8993-1f271d27aaea None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:16.877660 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 271/545] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:16 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:16.889472 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e367b-78e4-458a-b267-95bfd4b76fb7 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:17.143852 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c16e367b-78e4-458a-b267-95bfd4b76fb7 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:17.228602 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488f833-c50c-4793-bb04-8d17dab8f410 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:17.229775 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488f833-c50c-4793-bb04-8d17dab8f410 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:17.230241 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488f833-c50c-4793-bb04-8d17dab8f410 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:17.230715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b488f833-c50c-4793-bb04-8d17dab8f410 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:17.252311 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b488f833-c50c-4793-bb04-8d17dab8f410 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:17.262884 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-b488f833-c50c-4793-bb04-8d17dab8f410 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:17.262884 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:17.262884 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:17.262884 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:17.262884 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:17.262884 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:17.262884 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:17.262884 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:17.262884 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:17.262884 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:17.262884 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:17.262884 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:17.262884 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:17.262884 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:17.262884 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:17.262884 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:17.264625 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:17.264625 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:17.264625 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:17.264625 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:17.264625 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:17.264625 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:17.264625 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:17.264625 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:17.264625 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:17.264625 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:17.264625 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:17.264625 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:17.264625 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:17.264625 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:17.264625 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:17.264625 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:17.267797 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:17.267797 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:17.267797 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:17.267797 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:17.267797 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:17.267797 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:17.267797 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:17.267797 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:17.267797 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:17.267797 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:17.267797 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:17.267797 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:17.267797 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 275/546] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:16 2022] GET /identity/v3/roles/service => generated 85 bytes in 377 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:17.275278 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cf4a1-2b92-4268-8993-1f271d27aaea None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:17.357674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:17.447958 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488f833-c50c-4793-bb04-8d17dab8f410 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:17.522749 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-093cf4a1-2b92-4268-8993-1f271d27aaea None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:17.535954 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:17.655889 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edce58-6755-453d-9e3a-25e6a23c1f26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:17.656979 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edce58-6755-453d-9e3a-25e6a23c1f26 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:17.657380 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edce58-6755-453d-9e3a-25e6a23c1f26 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:17.657843 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40edce58-6755-453d-9e3a-25e6a23c1f26 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:17.659076 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40edce58-6755-453d-9e3a-25e6a23c1f26 None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:17.659611 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40edce58-6755-453d-9e3a-25e6a23c1f26 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:17.662223 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-40edce58-6755-453d-9e3a-25e6a23c1f26 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:17.699098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 272/547] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 425 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:17.702243 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edce58-6755-453d-9e3a-25e6a23c1f26 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:17.818220 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b488f833-c50c-4793-bb04-8d17dab8f410 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:17.944875 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:17.946120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf531122-3666-4e03-ac66-2a7473a3e418 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:17.946729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf531122-3666-4e03-ac66-2a7473a3e418 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:17.947320 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf531122-3666-4e03-ac66-2a7473a3e418 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:17.947649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf531122-3666-4e03-ac66-2a7473a3e418 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:17.959772 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-40edce58-6755-453d-9e3a-25e6a23c1f26 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:17.961958 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf531122-3666-4e03-ac66-2a7473a3e418 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:17.973094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-bf531122-3666-4e03-ac66-2a7473a3e418 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:17.973094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:17.973094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:17.973094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:17.973094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:17.973094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:17.973094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:17.973094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:17.973094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:17.973094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:17.973094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:17.973094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:17.973094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:17.973094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:17.973094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:17.973094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:17.974923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:17.974923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:17.974923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:17.974923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:17.974923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:17.974923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:17.974923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:17.974923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:17.974923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:17.974923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:17.974923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:17.974923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:17.974923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:17.974923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:17.974923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:17.974923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:17.976481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:17.976481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:17.976481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:17.976481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:17.976481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:17.976481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:17.976481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:17.976481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:17.976481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:17.976481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:17.976481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:17.976481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:17.976481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 276/548] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:17 2022] GET /identity/v3/roles/service => generated 85 bytes in 523 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:17.976481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108147a8-dc99-461a-ac72-33b1bc2f920e None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:17.988072 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108147a8-dc99-461a-ac72-33b1bc2f920e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:17.988072 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-108147a8-dc99-461a-ac72-33b1bc2f920e None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:17.988072 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 277/549] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:17 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:17.988072 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108147a8-dc99-461a-ac72-33b1bc2f920e None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:18.011443 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bf795c6-7acd-47ef-b512-f79b8f63bc68 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:18.013464 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf795c6-7acd-47ef-b512-f79b8f63bc68 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:18.014528 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf795c6-7acd-47ef-b512-f79b8f63bc68 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:18.015915 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bf795c6-7acd-47ef-b512-f79b8f63bc68 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:18.045193 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf795c6-7acd-47ef-b512-f79b8f63bc68 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:18.048390 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bf795c6-7acd-47ef-b512-f79b8f63bc68 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:18.084458 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-8bf795c6-7acd-47ef-b512-f79b8f63bc68 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:18.084458 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:18.084458 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:18.084458 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:18.084458 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:18.084458 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:18.084458 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:18.084458 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:18.084458 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:18.084458 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:18.084458 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:18.084458 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:18.084458 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:18.084458 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:18.084458 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:18.084458 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:18.087285 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:18.087285 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:18.087285 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:18.087285 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:18.087285 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:18.087285 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:18.087285 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:18.087285 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:18.087285 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:18.087285 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:18.087285 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:18.087285 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:18.087285 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:18.087285 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:18.087285 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:18.087285 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:18.087285 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:18.088899 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:18.088899 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:18.088899 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:18.091943 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 273/550] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:17 2022] GET /identity/v3/domains/Default => generated 87 bytes in 385 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:18.093538 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ef2b0-3579-48ee-ae8b-11f328dfbae1 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:18.093925 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ef2b0-3579-48ee-ae8b-11f328dfbae1 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:18.094272 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c8ef2b0-3579-48ee-ae8b-11f328dfbae1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:18.117131 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-8c8ef2b0-3579-48ee-ae8b-11f328dfbae1 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:18.118474 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8c8ef2b0-3579-48ee-ae8b-11f328dfbae1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:18.139662 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:18.167337 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-108147a8-dc99-461a-ac72-33b1bc2f920e None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:18.219764 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697658cd-3eab-4fa1-b939-ee87e42e2f20 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:18.221131 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697658cd-3eab-4fa1-b939-ee87e42e2f20 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:18.221131 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697658cd-3eab-4fa1-b939-ee87e42e2f20 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:18.221131 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697658cd-3eab-4fa1-b939-ee87e42e2f20 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:18.222369 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697658cd-3eab-4fa1-b939-ee87e42e2f20 None admin] RBAC: Adding query filter params (name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:18.222369 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697658cd-3eab-4fa1-b939-ee87e42e2f20 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:18.223938 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697658cd-3eab-4fa1-b939-ee87e42e2f20 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:18.241084 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 278/551] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:17 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:18.241084 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697658cd-3eab-4fa1-b939-ee87e42e2f20 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:18.278258 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 274/552] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:18.280251 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ef2b0-3579-48ee-ae8b-11f328dfbae1 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:18.442719 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:18.509867 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697658cd-3eab-4fa1-b939-ee87e42e2f20 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:18.520071 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c8ef2b0-3579-48ee-ae8b-11f328dfbae1 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:18.586844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bcd388c-473e-4ed9-9c88-26d3b2e31e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:18.587884 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd388c-473e-4ed9-9c88-26d3b2e31e1b None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:18.588410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd388c-473e-4ed9-9c88-26d3b2e31e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:18.589477 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bcd388c-473e-4ed9-9c88-26d3b2e31e1b None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:18.590725 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd388c-473e-4ed9-9c88-26d3b2e31e1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:18.590877 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1fc16ed3-8470-40d7-9380-f846a135088a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:18.591478 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd388c-473e-4ed9-9c88-26d3b2e31e1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:18.591800 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc16ed3-8470-40d7-9380-f846a135088a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:18.592245 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc16ed3-8470-40d7-9380-f846a135088a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:18.592970 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fc16ed3-8470-40d7-9380-f846a135088a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:18.593952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bcd388c-473e-4ed9-9c88-26d3b2e31e1b None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:18.613391 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc16ed3-8470-40d7-9380-f846a135088a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:18.615258 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 279/553] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 379 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:18.615969 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1fc16ed3-8470-40d7-9380-f846a135088a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:18.617307 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36530bb0-f2b8-47a8-90a8-2f9f6eb87667 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:18.618074 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36530bb0-f2b8-47a8-90a8-2f9f6eb87667 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:18.618769 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36530bb0-f2b8-47a8-90a8-2f9f6eb87667 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:18.620993 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 280/554] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:18 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:18.622178 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36530bb0-f2b8-47a8-90a8-2f9f6eb87667 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:18.628718 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:18.659231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-1fc16ed3-8470-40d7-9380-f846a135088a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:18.659231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:18.659231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:18.659231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:18.659231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:18.659231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:18.659231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:18.659231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:18.659231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:18.659231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:18.659231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:18.659231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:18.659231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:18.659231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:18.659231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:18.659231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:18.661859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:18.661859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:18.661859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:18.661859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:18.661859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:18.661859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:18.661859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:18.661859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:18.661859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:18.661859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:18.661859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:18.661859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:18.661859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:18.661859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:18.661859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:18.661859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:18.661859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:18.663513 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:18.663513 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:18.663513 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:18.669492 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 275/555] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:18 2022] GET /identity/v3/domains/Default => generated 87 bytes in 382 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:18.671860 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb372ed-fc59-4b72-89f6-7df59fda3722 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:18.672371 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb372ed-fc59-4b72-89f6-7df59fda3722 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:18.673107 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0fb372ed-fc59-4b72-89f6-7df59fda3722 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:18.709146 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-0fb372ed-fc59-4b72-89f6-7df59fda3722 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:18.711168 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0fb372ed-fc59-4b72-89f6-7df59fda3722 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:18.785077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36530bb0-f2b8-47a8-90a8-2f9f6eb87667 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:18.840818 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 276/556] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:18 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 171 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:18.842719 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb372ed-fc59-4b72-89f6-7df59fda3722 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:18.850900 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0008fb-5c5e-4db7-b577-05f467f6e6fe None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:18.852076 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0008fb-5c5e-4db7-b577-05f467f6e6fe None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:18.852581 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0008fb-5c5e-4db7-b577-05f467f6e6fe None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:18.853110 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d0008fb-5c5e-4db7-b577-05f467f6e6fe None admin] PATH_INFO: `/v3/users/swift` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:18.868348 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0008fb-5c5e-4db7-b577-05f467f6e6fe None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:18.871338 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6d0008fb-5c5e-4db7-b577-05f467f6e6fe None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:18.896079 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-6d0008fb-5c5e-4db7-b577-05f467f6e6fe None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:52:18.896079 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:18.896079 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:18.896079 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:18.896079 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:18.896079 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:18.896079 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:18.896079 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:18.896079 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:18.896079 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:18.896079 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:18.896079 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:18.896079 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:18.896079 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:18.896079 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:18.896079 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:18.897100 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:18.897100 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:18.897100 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:18.897100 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:18.897100 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:18.897100 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:18.897100 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:18.897100 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:18.897100 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:18.897100 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:18.897100 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:18.897100 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:18.897100 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:18.897100 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:18.897100 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:18.897100 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:18.897100 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:18.897100 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:18.898063 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:18.898063 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:18.898063 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:18.898063 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:18.898063 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:18.898063 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:18.898063 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:18.898063 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:18.898063 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:52:18.898063 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:18.898577 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 281/557] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:52:18 2022] GET /identity/v3/users/swift => generated 83 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:18.899749 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0008fb-5c5e-4db7-b577-05f467f6e6fe None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:18.960280 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:19.031003 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:19.056686 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0fb372ed-fc59-4b72-89f6-7df59fda3722 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:19.108256 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d0008fb-5c5e-4db7-b577-05f467f6e6fe None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:19.109715 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5112f6-185a-40c1-9eb7-f37127a6e219 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:19.110527 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5112f6-185a-40c1-9eb7-f37127a6e219 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:19.111129 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5112f6-185a-40c1-9eb7-f37127a6e219 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:19.111400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5112f6-185a-40c1-9eb7-f37127a6e219 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:19.112082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5112f6-185a-40c1-9eb7-f37127a6e219 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:19.112379 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5112f6-185a-40c1-9eb7-f37127a6e219 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:19.113988 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5112f6-185a-40c1-9eb7-f37127a6e219 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:19.143806 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 277/558] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:19.145927 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6b62b-d604-47fb-93ce-a50136c73910 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:19.146392 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6b62b-d604-47fb-93ce-a50136c73910 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:19.146830 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2c6b62b-d604-47fb-93ce-a50136c73910 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:19.149076 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 278/559] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:19 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:19.150364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6b62b-d604-47fb-93ce-a50136c73910 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:19.177235 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f69813-ab48-49af-925f-7185f9f12d4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:19.178310 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f69813-ab48-49af-925f-7185f9f12d4a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:19.178790 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f69813-ab48-49af-925f-7185f9f12d4a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:19.179195 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31f69813-ab48-49af-925f-7185f9f12d4a None admin] PATH_INFO: `/v3/roles/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:19.193863 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31f69813-ab48-49af-925f-7185f9f12d4a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:19.199406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-31f69813-ab48-49af-925f-7185f9f12d4a None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:19.199406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:19.199406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:19.199406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:19.199406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:19.199406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:19.199406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:19.199406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:19.199406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:19.199406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:19.199406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:19.199406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:19.199406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:19.199406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:19.199406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:19.199406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:19.201399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:19.201399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:19.201399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:19.201399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:19.201399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:19.201399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:19.201399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:19.201399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:19.201399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:19.201399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:19.201399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:19.201399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:19.201399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:19.201399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:19.201399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:19.201399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:19.202997 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:19.202997 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:19.202997 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:19.202997 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:19.202997 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:19.202997 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:19.202997 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:19.202997 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:19.202997 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:19.202997 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:19.202997 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:19.202997 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:19.202997 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 282/560] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 302 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:19.202997 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f69813-ab48-49af-925f-7185f9f12d4a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:19.326023 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2c6b62b-d604-47fb-93ce-a50136c73910 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:19.351299 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:19.363964 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31f69813-ab48-49af-925f-7185f9f12d4a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:19.405759 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc79fef-cfd2-4c32-a16d-8d4a9c373c8b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:19.406632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:19.406801 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc79fef-cfd2-4c32-a16d-8d4a9c373c8b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:19.407167 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc79fef-cfd2-4c32-a16d-8d4a9c373c8b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:19.407624 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc79fef-cfd2-4c32-a16d-8d4a9c373c8b None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:19.408962 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc79fef-cfd2-4c32-a16d-8d4a9c373c8b None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:19.409533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc79fef-cfd2-4c32-a16d-8d4a9c373c8b None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:19.411941 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc79fef-cfd2-4c32-a16d-8d4a9c373c8b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:19.436457 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1167a1-c184-4aee-88d9-be794f4a1993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:19.437510 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1167a1-c184-4aee-88d9-be794f4a1993 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:19.437941 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1167a1-c184-4aee-88d9-be794f4a1993 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:19.438385 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1167a1-c184-4aee-88d9-be794f4a1993 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:19.446553 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 279/561] 10.222.0.49 () {56 vars in 1135 bytes} [Sun Aug 21 00:52:19 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:19.448611 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f748d9-1733-4e49-9225-ea8e12a7f00b None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:19.449710 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f748d9-1733-4e49-9225-ea8e12a7f00b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:19.449710 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52f748d9-1733-4e49-9225-ea8e12a7f00b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:19.454877 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1167a1-c184-4aee-88d9-be794f4a1993 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:19.457397 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1167a1-c184-4aee-88d9-be794f4a1993 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:19.475571 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-ee1167a1-c184-4aee-88d9-be794f4a1993 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:52:19.475571 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:19.475571 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:19.475571 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:19.475571 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:19.475571 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:19.475571 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:19.475571 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:19.475571 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:19.475571 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:19.475571 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:19.475571 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:19.475571 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:19.475571 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:19.475571 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:19.475571 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:19.477632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:19.477632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:19.477632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:19.477632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:19.477632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:19.477632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:19.477632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:19.477632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:19.477632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:19.477632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:19.477632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:19.477632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:19.477632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:19.477632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:19.477632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:19.477632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:19.477632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:19.477632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:19.479735 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:19.479735 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:19.479735 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:19.479735 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:19.479735 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:19.479735 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:19.479735 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:19.479735 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:19.479735 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:52:19.479735 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:19.479735 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 283/562] 10.222.0.49 () {56 vars in 1093 bytes} [Sun Aug 21 00:52:19 2022] GET /identity/v3/users/nova => generated 82 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:19.479735 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1167a1-c184-4aee-88d9-be794f4a1993 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:19.485256 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-52f748d9-1733-4e49-9225-ea8e12a7f00b None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:19.486505 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-52f748d9-1733-4e49-9225-ea8e12a7f00b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:19.603962 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 280/563] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:19 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:19.605416 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f748d9-1733-4e49-9225-ea8e12a7f00b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:19.622196 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1167a1-c184-4aee-88d9-be794f4a1993 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:19.679079 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39cd0a-aa64-49c3-ad1f-08165dfb57e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:19.680161 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39cd0a-aa64-49c3-ad1f-08165dfb57e4 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:19.680555 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39cd0a-aa64-49c3-ad1f-08165dfb57e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:19.681113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a39cd0a-aa64-49c3-ad1f-08165dfb57e4 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:19.699815 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a39cd0a-aa64-49c3-ad1f-08165dfb57e4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:19.711074 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-2a39cd0a-aa64-49c3-ad1f-08165dfb57e4 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:19.711074 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:19.711074 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:19.711074 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:19.711074 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:19.711074 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:19.711074 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:19.711074 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:19.711074 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:19.711074 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:19.711074 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:19.711074 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:19.711074 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:19.711074 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:19.711074 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:19.711074 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:19.713006 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:19.713006 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:19.713006 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:19.713006 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:19.713006 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:19.713006 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:19.713006 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:19.713006 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:19.713006 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:19.713006 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:19.713006 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:19.713006 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:19.713006 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:19.713006 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:19.713006 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:19.713006 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:19.714755 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:19.714755 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:19.714755 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:19.714755 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:19.714755 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:19.714755 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:19.714755 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:19.714755 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:19.714755 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:19.714755 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:19.714755 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:19.714755 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:19.720793 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 284/564] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:19 2022] GET /identity/v3/roles/service => generated 85 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:19.722483 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39cd0a-aa64-49c3-ad1f-08165dfb57e4 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:19.778708 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:19.786709 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52f748d9-1733-4e49-9225-ea8e12a7f00b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:19.813833 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:19.862661 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ad691-11ef-4d75-9418-903a97081b65 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:19.863769 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ad691-11ef-4d75-9418-903a97081b65 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:19.864463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ad691-11ef-4d75-9418-903a97081b65 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:19.864939 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad7ad691-11ef-4d75-9418-903a97081b65 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:19.866226 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ad691-11ef-4d75-9418-903a97081b65 None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:19.866750 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ad691-11ef-4d75-9418-903a97081b65 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:19.868827 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad7ad691-11ef-4d75-9418-903a97081b65 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:19.883394 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 281/565] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:19 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 279 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:19.886949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ad691-11ef-4d75-9418-903a97081b65 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:19.916423 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a39cd0a-aa64-49c3-ad1f-08165dfb57e4 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:19.977070 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768fbfa-a03d-4bf4-8281-fec16ba38d1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:19.978184 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768fbfa-a03d-4bf4-8281-fec16ba38d1a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:19.978677 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768fbfa-a03d-4bf4-8281-fec16ba38d1a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:19.979162 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6768fbfa-a03d-4bf4-8281-fec16ba38d1a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:20.036329 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad7ad691-11ef-4d75-9418-903a97081b65 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:20.098522 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768fbfa-a03d-4bf4-8281-fec16ba38d1a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:20.100169 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac0e1f-435b-4c03-844e-4ebfcca9773f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:20.101167 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac0e1f-435b-4c03-844e-4ebfcca9773f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:20.101427 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6768fbfa-a03d-4bf4-8281-fec16ba38d1a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:20.101639 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac0e1f-435b-4c03-844e-4ebfcca9773f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:20.102099 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65ac0e1f-435b-4c03-844e-4ebfcca9773f None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:20.103468 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac0e1f-435b-4c03-844e-4ebfcca9773f None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:20.103976 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac0e1f-435b-4c03-844e-4ebfcca9773f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:20.106680 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65ac0e1f-435b-4c03-844e-4ebfcca9773f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:20.138594 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 282/566] 10.222.0.49 () {56 vars in 1133 bytes} [Sun Aug 21 00:52:19 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 253 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:20.139846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac0e1f-435b-4c03-844e-4ebfcca9773f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:20.176201 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:20.187331 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:20.283674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 285/567] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:19 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 562 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:52:20.285225 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768fbfa-a03d-4bf4-8281-fec16ba38d1a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:20.322101 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65ac0e1f-435b-4c03-844e-4ebfcca9773f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:20.386961 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e0ccf-43cb-4a94-9b52-fceb18e705d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:20.387989 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e0ccf-43cb-4a94-9b52-fceb18e705d2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:20.388447 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e0ccf-43cb-4a94-9b52-fceb18e705d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:20.388956 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09e0ccf-43cb-4a94-9b52-fceb18e705d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:20.390114 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e0ccf-43cb-4a94-9b52-fceb18e705d2 None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:20.390631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e0ccf-43cb-4a94-9b52-fceb18e705d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:20.393281 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09e0ccf-43cb-4a94-9b52-fceb18e705d2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:20.408173 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 283/568] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:20 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:20.409722 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e0ccf-43cb-4a94-9b52-fceb18e705d2 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:20.413148 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6768fbfa-a03d-4bf4-8281-fec16ba38d1a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:20.455742 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264372b1-b1d4-4991-862f-5fea32df7eb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:20.456702 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264372b1-b1d4-4991-862f-5fea32df7eb8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:20.457168 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264372b1-b1d4-4991-862f-5fea32df7eb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:20.457603 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-264372b1-b1d4-4991-862f-5fea32df7eb8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:20.473831 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264372b1-b1d4-4991-862f-5fea32df7eb8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:20.475459 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-264372b1-b1d4-4991-862f-5fea32df7eb8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:20.478821 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:20.495019 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-264372b1-b1d4-4991-862f-5fea32df7eb8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:20.495019 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:20.495019 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:20.495019 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:20.495019 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:20.495019 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:20.495019 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:20.495019 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:20.495019 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:20.495019 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:20.495019 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:20.495019 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:20.495019 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:20.495019 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:20.495019 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:20.495019 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:20.497075 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:20.497075 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:20.497075 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:20.497075 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:20.497075 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:20.497075 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:20.497075 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:20.497075 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:20.497075 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:20.497075 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:20.497075 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:20.497075 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:20.497075 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:20.497075 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:20.497075 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:20.497075 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:20.497075 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:20.504602 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:20.504602 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:20.504602 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:20.504602 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 286/569] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 214 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:20.504602 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264372b1-b1d4-4991-862f-5fea32df7eb8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:20.548974 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:20.574016 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09e0ccf-43cb-4a94-9b52-fceb18e705d2 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:20.627652 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d156101-d1dd-45dc-ba9c-63c833ca8554 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:20.628487 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d156101-d1dd-45dc-ba9c-63c833ca8554 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:20.628884 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d156101-d1dd-45dc-ba9c-63c833ca8554 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:20.629311 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d156101-d1dd-45dc-ba9c-63c833ca8554 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:20.643102 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d156101-d1dd-45dc-ba9c-63c833ca8554 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:20.648675 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-4d156101-d1dd-45dc-ba9c-63c833ca8554 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:20.648675 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:20.648675 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:20.648675 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:20.648675 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:20.648675 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:20.648675 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:20.648675 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:20.648675 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:20.648675 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:20.648675 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:20.648675 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:20.648675 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:20.648675 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:20.648675 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:20.648675 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:20.650795 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:20.650795 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:20.650795 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:20.650795 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:20.650795 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:20.650795 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:20.650795 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:20.650795 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:20.650795 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:20.650795 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:20.650795 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:20.650795 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:20.650795 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:20.650795 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:20.650795 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:20.650795 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:20.652704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:20.652704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:20.652704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:20.652704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:20.652704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:20.652704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:20.652704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:20.652704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:20.652704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:20.652704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:20.652704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:20.652704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:20.652704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 284/570] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:20 2022] GET /identity/v3/roles/service => generated 85 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:20.652704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d156101-d1dd-45dc-ba9c-63c833ca8554 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:20.683708 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-264372b1-b1d4-4991-862f-5fea32df7eb8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:20.747414 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cab213-e77f-4999-9096-7934e8070251 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:20.748521 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cab213-e77f-4999-9096-7934e8070251 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:20.748998 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cab213-e77f-4999-9096-7934e8070251 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:20.749494 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cab213-e77f-4999-9096-7934e8070251 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:20.771555 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cab213-e77f-4999-9096-7934e8070251 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:20.774534 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cab213-e77f-4999-9096-7934e8070251 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:20.803713 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-71cab213-e77f-4999-9096-7934e8070251 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:20.803713 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:20.803713 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:20.803713 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:20.803713 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:20.803713 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:20.803713 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:20.803713 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:20.803713 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:20.803713 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:20.803713 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:20.803713 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:20.803713 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:20.803713 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:20.803713 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:20.803713 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:20.805702 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:20.805702 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:20.805702 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:20.805702 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:20.805702 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:20.805702 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:20.805702 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:20.805702 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:20.805702 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:20.805702 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:20.805702 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:20.805702 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:20.805702 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:20.805702 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:20.805702 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:20.805702 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:20.805702 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:20.807400 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:20.807400 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:20.807400 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:20.807400 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 287/571] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 307 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:20.807400 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cab213-e77f-4999-9096-7934e8070251 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:20.848333 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d156101-d1dd-45dc-ba9c-63c833ca8554 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:20.914440 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bafa8ee-b650-4ac7-b8b6-9d61b4fbe3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:20.915218 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafa8ee-b650-4ac7-b8b6-9d61b4fbe3ae None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:20.915709 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafa8ee-b650-4ac7-b8b6-9d61b4fbe3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:20.916188 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1bafa8ee-b650-4ac7-b8b6-9d61b4fbe3ae None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:20.920121 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:20.939485 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bafa8ee-b650-4ac7-b8b6-9d61b4fbe3ae None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:20.942332 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1bafa8ee-b650-4ac7-b8b6-9d61b4fbe3ae None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:20.945869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:20.972533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-1bafa8ee-b650-4ac7-b8b6-9d61b4fbe3ae None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:20.972533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:20.972533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:20.972533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:20.972533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:20.972533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:20.972533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:20.972533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:20.972533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:20.972533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:20.972533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:20.972533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:20.972533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:20.972533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:20.972533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:20.972533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:20.974763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:20.974763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:20.974763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:20.974763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:20.974763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:20.974763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:20.974763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:20.974763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:20.974763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:20.974763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:20.974763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:20.974763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:20.974763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:20.974763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:20.974763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:20.974763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:20.974763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:20.976523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:20.976523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:20.976523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:20.976523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 285/572] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:20.976523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bafa8ee-b650-4ac7-b8b6-9d61b4fbe3ae None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:21.028546 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cab213-e77f-4999-9096-7934e8070251 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:21.092862 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fae7b-2526-4d51-a949-ecf39ac26042 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:21.094134 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fae7b-2526-4d51-a949-ecf39ac26042 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:21.094597 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fae7b-2526-4d51-a949-ecf39ac26042 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:21.094991 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b33fae7b-2526-4d51-a949-ecf39ac26042 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:21.115586 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33fae7b-2526-4d51-a949-ecf39ac26042 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:21.118529 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b33fae7b-2526-4d51-a949-ecf39ac26042 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:21.147661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-b33fae7b-2526-4d51-a949-ecf39ac26042 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:21.147661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:21.147661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:21.147661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:21.147661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:21.147661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:21.147661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:21.147661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:21.147661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:21.147661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:21.147661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:21.147661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:21.147661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:21.147661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:21.147661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:21.147661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:21.149674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:21.149674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:21.149674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:21.149674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:21.149674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:21.149674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:21.149674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:21.149674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:21.149674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:21.149674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:21.149674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:21.149674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:21.149674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:21.149674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:21.149674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:21.149674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:21.149674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:21.151412 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:21.151412 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:21.151412 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:21.151412 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 288/573] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 343 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:21.151412 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fae7b-2526-4d51-a949-ecf39ac26042 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:21.169405 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1bafa8ee-b650-4ac7-b8b6-9d61b4fbe3ae None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:21.215894 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade88fbb-0340-4dba-9f95-1417725635b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:21.216923 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade88fbb-0340-4dba-9f95-1417725635b6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:21.217446 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade88fbb-0340-4dba-9f95-1417725635b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:21.217928 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ade88fbb-0340-4dba-9f95-1417725635b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:21.219062 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade88fbb-0340-4dba-9f95-1417725635b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:21.219602 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade88fbb-0340-4dba-9f95-1417725635b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:21.221900 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ade88fbb-0340-4dba-9f95-1417725635b6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:21.241350 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 286/574] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 266 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:21.242418 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade88fbb-0340-4dba-9f95-1417725635b6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:21.316247 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:21.320295 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b33fae7b-2526-4d51-a949-ecf39ac26042 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:21.346105 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:21.367391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bfef1-4852-4e41-8cd5-d8ea2f1db37d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:21.368069 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bfef1-4852-4e41-8cd5-d8ea2f1db37d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:21.368379 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bfef1-4852-4e41-8cd5-d8ea2f1db37d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:21.368816 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b1bfef1-4852-4e41-8cd5-d8ea2f1db37d None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:21.369771 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bfef1-4852-4e41-8cd5-d8ea2f1db37d None admin] RBAC: Adding query filter params (name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:21.370122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bfef1-4852-4e41-8cd5-d8ea2f1db37d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:21.372281 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b1bfef1-4852-4e41-8cd5-d8ea2f1db37d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:21.393510 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 289/575] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:21 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 236 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:21.393510 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bfef1-4852-4e41-8cd5-d8ea2f1db37d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:21.414548 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ade88fbb-0340-4dba-9f95-1417725635b6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:21.458797 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a09c0-dea5-4bb7-837c-0afcfc177d0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:21.459777 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a09c0-dea5-4bb7-837c-0afcfc177d0c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:21.460223 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a09c0-dea5-4bb7-837c-0afcfc177d0c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:21.460502 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e3a09c0-dea5-4bb7-837c-0afcfc177d0c None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:21.461446 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a09c0-dea5-4bb7-837c-0afcfc177d0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:21.461836 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a09c0-dea5-4bb7-837c-0afcfc177d0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:21.463473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e3a09c0-dea5-4bb7-837c-0afcfc177d0c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:21.485423 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 287/576] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:21.485423 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a09c0-dea5-4bb7-837c-0afcfc177d0c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:21.523092 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b1bfef1-4852-4e41-8cd5-d8ea2f1db37d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:21.570353 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd1b78-6d61-434b-b87e-7968dc9e4262 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:21.570353 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd1b78-6d61-434b-b87e-7968dc9e4262 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:21.570353 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd1b78-6d61-434b-b87e-7968dc9e4262 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:21.570353 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22dd1b78-6d61-434b-b87e-7968dc9e4262 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:21.571056 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd1b78-6d61-434b-b87e-7968dc9e4262 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:21.571056 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd1b78-6d61-434b-b87e-7968dc9e4262 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:21.571056 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22dd1b78-6d61-434b-b87e-7968dc9e4262 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:21.586197 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 290/577] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:21.587368 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd1b78-6d61-434b-b87e-7968dc9e4262 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:21.621750 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:21.630859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e3a09c0-dea5-4bb7-837c-0afcfc177d0c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:21.653840 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:21.681919 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf094c3-49b3-4ec8-9456-9a4aaa589e1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:21.682546 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf094c3-49b3-4ec8-9456-9a4aaa589e1b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:21.682896 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf094c3-49b3-4ec8-9456-9a4aaa589e1b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:21.683216 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adf094c3-49b3-4ec8-9456-9a4aaa589e1b None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:21.683862 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf094c3-49b3-4ec8-9456-9a4aaa589e1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:21.684166 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf094c3-49b3-4ec8-9456-9a4aaa589e1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:21.685606 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adf094c3-49b3-4ec8-9456-9a4aaa589e1b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:21.699486 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 288/578] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 219 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:21.700547 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf094c3-49b3-4ec8-9456-9a4aaa589e1b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:21.744221 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22dd1b78-6d61-434b-b87e-7968dc9e4262 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:21.787916 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca7850-e974-4c4f-83e8-aee88bce73de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:21.788575 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca7850-e974-4c4f-83e8-aee88bce73de None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:21.788889 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca7850-e974-4c4f-83e8-aee88bce73de None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:21.789168 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ca7850-e974-4c4f-83e8-aee88bce73de None admin] PATH_INFO: `/v3/users/glance` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:21.797681 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca7850-e974-4c4f-83e8-aee88bce73de None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:21.799207 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5ca7850-e974-4c4f-83e8-aee88bce73de None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:21.812386 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-d5ca7850-e974-4c4f-83e8-aee88bce73de None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 21 00:52:21.812386 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:21.812386 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:21.812386 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:21.812386 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:21.812386 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:21.812386 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:21.812386 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:21.812386 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:21.812386 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:21.812386 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:21.812386 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:21.812386 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:21.812386 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:21.812386 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:21.812386 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:21.814332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:21.814332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:21.814332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:21.814332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:21.814332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:21.814332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:21.814332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:21.814332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:21.814332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:21.814332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:21.814332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:21.814332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:21.814332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:21.814332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:21.814332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:21.814332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:21.814332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:21.814332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:21.816177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:21.816177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:21.816177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:21.816177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:21.816177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:21.816177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:21.816177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:21.816177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:21.816177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 21 00:52:21.816177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:21.816177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 291/579] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:52:21 2022] GET /identity/v3/users/glance => generated 84 bytes in 227 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:21.816177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca7850-e974-4c4f-83e8-aee88bce73de None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:21.848454 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adf094c3-49b3-4ec8-9456-9a4aaa589e1b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:21.895347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70720279-dd4f-48b8-8ab8-a04e00ee3f7d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:21.895985 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70720279-dd4f-48b8-8ab8-a04e00ee3f7d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:21.896262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70720279-dd4f-48b8-8ab8-a04e00ee3f7d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:21.896529 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70720279-dd4f-48b8-8ab8-a04e00ee3f7d None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:21.908019 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70720279-dd4f-48b8-8ab8-a04e00ee3f7d None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:21.909608 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-70720279-dd4f-48b8-8ab8-a04e00ee3f7d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:21.930631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-70720279-dd4f-48b8-8ab8-a04e00ee3f7d None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:21.930631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:21.930631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:21.930631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:21.930631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:21.930631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:21.930631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:21.930631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:21.930631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:21.930631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:21.930631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:21.930631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:21.930631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:21.930631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:21.930631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:21.930631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:21.931698 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:21.931698 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:21.931698 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:21.931698 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:21.931698 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:21.931698 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:21.931698 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:21.931698 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:21.931698 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:21.931698 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:21.931698 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:21.931698 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:21.931698 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:21.931698 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:21.931698 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:21.931698 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:21.931698 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:21.932589 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:21.932589 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:21.932589 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:21.932810 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 289/580] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 233 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:21.933592 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70720279-dd4f-48b8-8ab8-a04e00ee3f7d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:21.939225 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:21.963695 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ca7850-e974-4c4f-83e8-aee88bce73de None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:21.971769 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:22.008631 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1653b7-05a5-48d3-8743-395e5c317805 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:22.009280 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1653b7-05a5-48d3-8743-395e5c317805 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:22.009565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1653b7-05a5-48d3-8743-395e5c317805 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:22.009830 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d1653b7-05a5-48d3-8743-395e5c317805 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:22.018390 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1653b7-05a5-48d3-8743-395e5c317805 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:22.020018 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d1653b7-05a5-48d3-8743-395e5c317805 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:22.034464 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-8d1653b7-05a5-48d3-8743-395e5c317805 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:22.034464 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:22.034464 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:22.034464 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:22.034464 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:22.034464 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:22.034464 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:22.034464 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:22.034464 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:22.034464 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:22.034464 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:22.034464 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:22.034464 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:22.034464 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:22.034464 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:22.035882 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:22.035882 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:22.035882 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:22.035882 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:22.035882 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:22.035882 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:22.035882 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:22.035882 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:22.035882 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:22.035882 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:22.035882 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:22.035882 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:22.035882 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:22.035882 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:22.035882 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:22.035882 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:22.035882 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:22.038206 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:22.038206 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:22.038206 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:22.038206 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:22.038206 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:22.038206 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:22.038206 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:22.038206 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:22.038206 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 292/581] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 222 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:22.038206 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1653b7-05a5-48d3-8743-395e5c317805 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:22.068844 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70720279-dd4f-48b8-8ab8-a04e00ee3f7d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:22.117143 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa5dde-b8c8-446b-b0d5-860861f55984 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:22.117906 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa5dde-b8c8-446b-b0d5-860861f55984 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:22.118338 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa5dde-b8c8-446b-b0d5-860861f55984 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:22.118778 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ffa5dde-b8c8-446b-b0d5-860861f55984 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:22.130039 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa5dde-b8c8-446b-b0d5-860861f55984 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:22.132272 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ffa5dde-b8c8-446b-b0d5-860861f55984 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:22.150960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-5ffa5dde-b8c8-446b-b0d5-860861f55984 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:22.150960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:22.150960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:22.150960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:22.150960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:22.150960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:22.150960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:22.150960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:22.150960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:22.150960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:22.150960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:22.150960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:22.150960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:22.150960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:22.150960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:22.152619 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:22.152619 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:22.152619 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:22.152619 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:22.152619 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:22.152619 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:22.152619 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:22.152619 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:22.152619 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:22.152619 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:22.152619 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:22.152619 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:22.152619 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:22.152619 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:22.152619 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:22.152619 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:22.152619 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:22.162370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:22.162370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:22.162370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:22.162370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:22.162370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:22.162370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:22.162370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:22.162370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:22.162370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 290/582] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:21 2022] GET /identity/v3/projects/service => generated 88 bytes in 220 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:22.162370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa5dde-b8c8-446b-b0d5-860861f55984 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:22.185176 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d1653b7-05a5-48d3-8743-395e5c317805 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:22.232111 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e8b38-30a1-49e6-b258-aba7bb6a9085 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:22.232855 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e8b38-30a1-49e6-b258-aba7bb6a9085 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:22.233275 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e8b38-30a1-49e6-b258-aba7bb6a9085 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:22.233644 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a6e8b38-30a1-49e6-b258-aba7bb6a9085 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:22.243381 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e8b38-30a1-49e6-b258-aba7bb6a9085 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:22.245408 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a6e8b38-30a1-49e6-b258-aba7bb6a9085 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:22.258808 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-0a6e8b38-30a1-49e6-b258-aba7bb6a9085 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 00:52:22.258808 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:22.258808 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:22.258808 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:22.258808 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:22.258808 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:22.258808 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:22.258808 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:22.258808 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:22.258808 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:22.258808 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:22.258808 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:22.258808 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:22.258808 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:22.258808 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:22.258808 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:22.259919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:22.259919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:22.259919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:22.259919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:22.259919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:22.259919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:22.259919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:22.259919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:22.259919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:22.259919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:22.259919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:22.259919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:22.259919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:22.259919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:22.259919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:22.259919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:22.259919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:22.259919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:22.261158 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:22.261158 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:22.261158 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:22.261158 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:22.261158 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:22.261158 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:22.261158 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:22.261158 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:22.261158 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 00:52:22.261158 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:22.261158 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 293/583] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:52:22 2022] GET /identity/v3/users/cinder => generated 84 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:22.262181 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e8b38-30a1-49e6-b258-aba7bb6a9085 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:22.265997 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:22.303911 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:22.323094 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ffa5dde-b8c8-446b-b0d5-860861f55984 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:22.367205 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7e50a-e0ab-4657-bebf-8f12b0f4a539 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:22.368284 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7e50a-e0ab-4657-bebf-8f12b0f4a539 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:22.368792 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7e50a-e0ab-4657-bebf-8f12b0f4a539 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:22.369262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfb7e50a-e0ab-4657-bebf-8f12b0f4a539 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:22.370704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7e50a-e0ab-4657-bebf-8f12b0f4a539 None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:22.371264 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7e50a-e0ab-4657-bebf-8f12b0f4a539 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:22.373982 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfb7e50a-e0ab-4657-bebf-8f12b0f4a539 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:22.392773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a6e8b38-30a1-49e6-b258-aba7bb6a9085 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:22.402178 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 291/584] 10.222.0.49 () {56 vars in 1137 bytes} [Sun Aug 21 00:52:22 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:22.403652 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7e50a-e0ab-4657-bebf-8f12b0f4a539 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:22.434945 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5effab8-c06a-4eaf-83e2-957baea5dab5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:22.435567 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5effab8-c06a-4eaf-83e2-957baea5dab5 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:22.435842 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5effab8-c06a-4eaf-83e2-957baea5dab5 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:22.436110 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5effab8-c06a-4eaf-83e2-957baea5dab5 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:22.436774 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5effab8-c06a-4eaf-83e2-957baea5dab5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:22.437149 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5effab8-c06a-4eaf-83e2-957baea5dab5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:22.438573 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5effab8-c06a-4eaf-83e2-957baea5dab5 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:22.455441 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 294/585] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:22 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:22.456841 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5effab8-c06a-4eaf-83e2-957baea5dab5 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:22.553398 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:22.562738 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfb7e50a-e0ab-4657-bebf-8f12b0f4a539 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:22.617085 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af2df5-8eaa-4b3c-bda4-143c6ec3ef44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:22.617566 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af2df5-8eaa-4b3c-bda4-143c6ec3ef44 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:22.618066 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af2df5-8eaa-4b3c-bda4-143c6ec3ef44 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:22.618540 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71af2df5-8eaa-4b3c-bda4-143c6ec3ef44 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:22.619625 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af2df5-8eaa-4b3c-bda4-143c6ec3ef44 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:22.620173 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af2df5-8eaa-4b3c-bda4-143c6ec3ef44 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:22.622893 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71af2df5-8eaa-4b3c-bda4-143c6ec3ef44 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:22.626319 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5effab8-c06a-4eaf-83e2-957baea5dab5 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:22.650449 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 292/586] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 243 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:22.650449 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af2df5-8eaa-4b3c-bda4-143c6ec3ef44 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:22.653465 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:22.689543 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef931ab4-627e-4a45-ba8b-472731f66e22 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:22.690309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef931ab4-627e-4a45-ba8b-472731f66e22 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:22.690778 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef931ab4-627e-4a45-ba8b-472731f66e22 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:22.691260 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef931ab4-627e-4a45-ba8b-472731f66e22 None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:22.692529 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef931ab4-627e-4a45-ba8b-472731f66e22 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:22.693073 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef931ab4-627e-4a45-ba8b-472731f66e22 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:22.695605 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef931ab4-627e-4a45-ba8b-472731f66e22 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:22.725544 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 295/587] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:22.725544 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef931ab4-627e-4a45-ba8b-472731f66e22 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:22.828858 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71af2df5-8eaa-4b3c-bda4-143c6ec3ef44 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:22.879114 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17438b75-1bb0-4352-b1aa-61abd10c6729 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:22.879963 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17438b75-1bb0-4352-b1aa-61abd10c6729 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:22.880431 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17438b75-1bb0-4352-b1aa-61abd10c6729 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:22.880740 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17438b75-1bb0-4352-b1aa-61abd10c6729 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:22.881736 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17438b75-1bb0-4352-b1aa-61abd10c6729 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:22.882043 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17438b75-1bb0-4352-b1aa-61abd10c6729 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:22.883837 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17438b75-1bb0-4352-b1aa-61abd10c6729 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:22.899242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef931ab4-627e-4a45-ba8b-472731f66e22 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:22.906641 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 293/588] 10.222.0.49 () {56 vars in 1137 bytes} [Sun Aug 21 00:52:22 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:22.907516 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17438b75-1bb0-4352-b1aa-61abd10c6729 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:22.926434 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:22.943970 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3124d35-0b74-467a-83d4-8ff7f9295fdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:22.944966 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3124d35-0b74-467a-83d4-8ff7f9295fdb None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:22.945259 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3124d35-0b74-467a-83d4-8ff7f9295fdb None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:22.945739 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c3124d35-0b74-467a-83d4-8ff7f9295fdb None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:22.966917 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3124d35-0b74-467a-83d4-8ff7f9295fdb None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:22.969713 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c3124d35-0b74-467a-83d4-8ff7f9295fdb None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:22.988656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-c3124d35-0b74-467a-83d4-8ff7f9295fdb None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:22.988656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:22.988656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:22.988656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:22.988656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:22.988656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:22.988656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:22.988656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:22.988656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:22.988656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:22.988656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:22.988656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:22.988656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:22.988656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:22.988656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:22.988656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:22.990505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:22.990505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:22.990505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:22.990505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:22.990505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:22.990505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:22.990505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:22.990505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:22.990505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:22.990505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:22.990505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:22.990505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:22.990505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:22.990505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:22.990505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:22.990505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:22.990505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:22.992336 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:22.992336 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:22.992336 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:22.992336 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 296/589] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:22 2022] GET /identity/v3/domains/Default => generated 87 bytes in 272 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:22.992336 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3124d35-0b74-467a-83d4-8ff7f9295fdb None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:23.001987 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:23.072173 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17438b75-1bb0-4352-b1aa-61abd10c6729 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:23.114672 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c3124d35-0b74-467a-83d4-8ff7f9295fdb None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:23.137804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d4f8f-0738-4dcc-aa85-72301a816190 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:23.138719 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d4f8f-0738-4dcc-aa85-72301a816190 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:23.139043 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d4f8f-0738-4dcc-aa85-72301a816190 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:23.139441 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215d4f8f-0738-4dcc-aa85-72301a816190 None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:23.150912 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d4f8f-0738-4dcc-aa85-72301a816190 None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:23.153246 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-215d4f8f-0738-4dcc-aa85-72301a816190 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:23.160905 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092dc978-7670-4a1c-ad20-79ad4fc456da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:23.161971 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dc978-7670-4a1c-ad20-79ad4fc456da None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:23.162422 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dc978-7670-4a1c-ad20-79ad4fc456da None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:23.162861 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-092dc978-7670-4a1c-ad20-79ad4fc456da None admin] PATH_INFO: `/v3/projects/838e996d09a0454b9bcdc5aef03ef203/users/6b003ae4a082485ab608bf84c1657159/roles/b549ba322af24099825f8949d2060adf` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:23.172830 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-215d4f8f-0738-4dcc-aa85-72301a816190 None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 21 00:52:23.172830 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:23.172830 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:23.172830 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:23.172830 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:23.172830 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:23.172830 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:23.172830 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:23.172830 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:23.172830 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:23.172830 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:23.172830 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:23.172830 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:23.172830 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:23.172830 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:23.172830 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:23.174406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:23.174406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:23.174406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:23.174406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:23.174406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:23.174406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:23.174406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:23.174406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:23.174406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:23.174406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:23.174406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:23.174406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:23.174406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:23.174406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:23.174406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:23.174406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:23.174406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:23.174406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:23.176044 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:23.176044 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:23.176044 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:23.176044 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:23.176044 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:23.176044 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:23.176044 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:23.176044 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:23.176044 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 21 00:52:23.176044 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:23.176044 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 294/590] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:22 2022] GET /identity/v3/users/neutron => generated 85 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:23.176044 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d4f8f-0738-4dcc-aa85-72301a816190 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:23.192818 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092dc978-7670-4a1c-ad20-79ad4fc456da None admin] RBAC: Authorizing `identity:create_grant(project_id=838e996d09a0454b9bcdc5aef03ef203, user_id=6b003ae4a082485ab608bf84c1657159, role_id=b549ba322af24099825f8949d2060adf)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:23.195325 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-092dc978-7670-4a1c-ad20-79ad4fc456da None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:23.212356 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 297/591] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 21 00:52:22 2022] PUT /identity/v3/projects/838e996d09a0454b9bcdc5aef03ef203/users/6b003ae4a082485ab608bf84c1657159/roles/b549ba322af24099825f8949d2060adf => generated 0 bytes in 222 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:52:23.213501 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092dc978-7670-4a1c-ad20-79ad4fc456da None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:23.265408 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:23.357406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-215d4f8f-0738-4dcc-aa85-72301a816190 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:23.393775 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-092dc978-7670-4a1c-ad20-79ad4fc456da None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:23.396370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:23.415272 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f178b5c-d8e3-4c4d-b682-186b717bf053 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:23.415897 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f178b5c-d8e3-4c4d-b682-186b717bf053 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:23.416172 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f178b5c-d8e3-4c4d-b682-186b717bf053 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:23.416463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1f178b5c-d8e3-4c4d-b682-186b717bf053 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:23.417568 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f178b5c-d8e3-4c4d-b682-186b717bf053 None admin] RBAC: Adding query filter params (role.id=b549ba322af24099825f8949d2060adf, scope.project.id=838e996d09a0454b9bcdc5aef03ef203, user.id=f66a877fdca340f48f54b48e5367a194) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:23.417876 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f178b5c-d8e3-4c4d-b682-186b717bf053 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:23.419937 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1f178b5c-d8e3-4c4d-b682-186b717bf053 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:23.433087 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 295/592] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:23 2022] GET /identity/v3/role_assignments?user.id=f66a877fdca340f48f54b48e5367a194&scope.project.id=838e996d09a0454b9bcdc5aef03ef203&role.id=b549ba322af24099825f8949d2060adf => generated 259 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:23.433087 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f178b5c-d8e3-4c4d-b682-186b717bf053 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:23.456685 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78786d1-62a9-4aa3-a9f9-db0de67ebe89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:23.457743 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78786d1-62a9-4aa3-a9f9-db0de67ebe89 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:23.458072 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78786d1-62a9-4aa3-a9f9-db0de67ebe89 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:23.458354 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a78786d1-62a9-4aa3-a9f9-db0de67ebe89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:23.471264 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78786d1-62a9-4aa3-a9f9-db0de67ebe89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:23.473231 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a78786d1-62a9-4aa3-a9f9-db0de67ebe89 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:23.497862 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-a78786d1-62a9-4aa3-a9f9-db0de67ebe89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:23.497862 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:23.497862 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:23.497862 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:23.497862 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:23.497862 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:23.497862 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:23.497862 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:23.497862 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:23.497862 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:23.497862 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:23.497862 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:23.497862 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:23.497862 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:23.497862 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:23.497862 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:23.498885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:23.498885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:23.498885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:23.498885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:23.498885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:23.498885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:23.498885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:23.498885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:23.498885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:23.498885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:23.498885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:23.498885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:23.498885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:23.498885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:23.498885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:23.498885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:23.498885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:23.499800 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:23.499800 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:23.499800 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:23.499800 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 298/593] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:23 2022] GET /identity/v3/domains/Default => generated 87 bytes in 287 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:23.500897 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78786d1-62a9-4aa3-a9f9-db0de67ebe89 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:23.630663 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:23.641696 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1f178b5c-d8e3-4c4d-b682-186b717bf053 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:23.679082 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a78786d1-62a9-4aa3-a9f9-db0de67ebe89 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:23.714089 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f82582-3680-4764-9ce3-25a5ff3bd7b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:23.715589 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f82582-3680-4764-9ce3-25a5ff3bd7b6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:23.716309 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f82582-3680-4764-9ce3-25a5ff3bd7b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:23.717017 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27f82582-3680-4764-9ce3-25a5ff3bd7b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:23.718498 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f82582-3680-4764-9ce3-25a5ff3bd7b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:23.719274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f82582-3680-4764-9ce3-25a5ff3bd7b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:23.722096 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27f82582-3680-4764-9ce3-25a5ff3bd7b6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:23.741709 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f2dfc-89a3-4ca8-b1ee-d21e596b0e89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:23.742763 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f2dfc-89a3-4ca8-b1ee-d21e596b0e89 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:23.743253 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f2dfc-89a3-4ca8-b1ee-d21e596b0e89 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:23.743731 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f67f2dfc-89a3-4ca8-b1ee-d21e596b0e89 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:23.744729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f2dfc-89a3-4ca8-b1ee-d21e596b0e89 None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:23.745402 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f2dfc-89a3-4ca8-b1ee-d21e596b0e89 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:23.747183 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 296/594] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:23.748124 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f67f2dfc-89a3-4ca8-b1ee-d21e596b0e89 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:23.749409 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f82582-3680-4764-9ce3-25a5ff3bd7b6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:23.784583 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 299/595] 10.222.0.49 () {56 vars in 1139 bytes} [Sun Aug 21 00:52:23 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:23.786223 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f2dfc-89a3-4ca8-b1ee-d21e596b0e89 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:23.838947 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:23.937132 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f67f2dfc-89a3-4ca8-b1ee-d21e596b0e89 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:23.972638 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27f82582-3680-4764-9ce3-25a5ff3bd7b6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:23.988041 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f8b5c-8dcf-4582-88f3-c787d682d9f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:23.988975 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f8b5c-8dcf-4582-88f3-c787d682d9f4 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:23.989422 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f8b5c-8dcf-4582-88f3-c787d682d9f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:23.989796 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-985f8b5c-8dcf-4582-88f3-c787d682d9f4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:23.992567 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:24.001076 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f8b5c-8dcf-4582-88f3-c787d682d9f4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:24.003440 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-985f8b5c-8dcf-4582-88f3-c787d682d9f4 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:24.019216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-985f8b5c-8dcf-4582-88f3-c787d682d9f4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:24.019216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:24.019216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:24.019216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:24.019216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:24.019216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:24.019216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:24.019216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:24.019216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:24.019216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:24.019216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:24.019216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:24.019216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:24.019216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:24.019216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:24.020927 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:24.020927 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:24.020927 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:24.020927 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:24.020927 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:24.020927 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:24.020927 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:24.020927 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:24.020927 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:24.020927 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:24.020927 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:24.020927 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:24.020927 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:24.020927 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:24.020927 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:24.020927 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:24.020927 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:24.022559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:24.022559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:24.022559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:24.022559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:24.022559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:24.022559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:24.022559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:24.022559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:24.023911 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 300/596] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:23 2022] GET /identity/v3/projects/service => generated 88 bytes in 239 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:24.025021 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f8b5c-8dcf-4582-88f3-c787d682d9f4 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:24.066523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf0261-9120-4301-9e38-ba8b15687e26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:24.067856 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf0261-9120-4301-9e38-ba8b15687e26 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:24.069118 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf0261-9120-4301-9e38-ba8b15687e26 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:24.069755 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf0261-9120-4301-9e38-ba8b15687e26 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:24.071398 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf0261-9120-4301-9e38-ba8b15687e26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:24.072099 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf0261-9120-4301-9e38-ba8b15687e26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:24.075607 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71cf0261-9120-4301-9e38-ba8b15687e26 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:24.101393 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 297/597] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:23 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:24.102566 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf0261-9120-4301-9e38-ba8b15687e26 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:24.209246 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-985f8b5c-8dcf-4582-88f3-c787d682d9f4 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:24.266482 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf0261-9120-4301-9e38-ba8b15687e26 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:24.267159 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c5d03-e048-4168-b465-88b0affe4e84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:24.268060 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c5d03-e048-4168-b465-88b0affe4e84 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:24.268894 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c5d03-e048-4168-b465-88b0affe4e84 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:24.269406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a1c5d03-e048-4168-b465-88b0affe4e84 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:24.276389 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:24.288271 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c5d03-e048-4168-b465-88b0affe4e84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:24.291142 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a1c5d03-e048-4168-b465-88b0affe4e84 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:24.315781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-5a1c5d03-e048-4168-b465-88b0affe4e84 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:24.315781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:24.315781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:24.315781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:24.315781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:24.315781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:24.315781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:24.315781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:24.315781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:24.315781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:24.315781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:24.315781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:24.315781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:24.315781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:24.315781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:24.315781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:24.317633 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:24.317633 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:24.317633 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:24.317633 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:24.317633 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:24.317633 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:24.317633 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:24.317633 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:24.317633 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:24.317633 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:24.317633 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:24.317633 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:24.317633 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:24.317633 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:24.317633 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:24.317633 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:24.317633 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:24.319939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:24.319939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:24.319939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:24.319939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 301/598] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:24 2022] GET /identity/v3/domains/Default => generated 87 bytes in 293 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:24.319939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c5d03-e048-4168-b465-88b0affe4e84 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:24.321348 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088cfc7-6877-45db-b2b6-08b83f9f8068 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:24.323021 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088cfc7-6877-45db-b2b6-08b83f9f8068 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:24.325127 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088cfc7-6877-45db-b2b6-08b83f9f8068 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:24.325833 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1088cfc7-6877-45db-b2b6-08b83f9f8068 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:24.327275 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088cfc7-6877-45db-b2b6-08b83f9f8068 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:24.328027 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088cfc7-6877-45db-b2b6-08b83f9f8068 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:24.330968 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1088cfc7-6877-45db-b2b6-08b83f9f8068 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:24.364730 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 298/599] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:24.366419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088cfc7-6877-45db-b2b6-08b83f9f8068 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:24.412107 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:24.495621 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a1c5d03-e048-4168-b465-88b0affe4e84 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:24.557698 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba492f-5103-42fd-a806-59f0469cddcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:24.558851 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba492f-5103-42fd-a806-59f0469cddcc None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:24.559337 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba492f-5103-42fd-a806-59f0469cddcc None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:24.559819 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcba492f-5103-42fd-a806-59f0469cddcc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:24.572791 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba492f-5103-42fd-a806-59f0469cddcc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:24.573585 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1088cfc7-6877-45db-b2b6-08b83f9f8068 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:24.575669 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcba492f-5103-42fd-a806-59f0469cddcc None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:24.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-dcba492f-5103-42fd-a806-59f0469cddcc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:24.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:24.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:24.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:24.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:24.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:24.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:24.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:24.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:24.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:24.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:24.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:24.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:24.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:24.599690 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:24.601222 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:24.601222 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:24.601222 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:24.601222 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:24.601222 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:24.601222 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:24.601222 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:24.601222 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:24.601222 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:24.601222 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:24.601222 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:24.601222 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:24.601222 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:24.601222 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:24.601222 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:24.601222 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:24.601222 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:24.602944 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:24.602944 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:24.602944 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:24.602944 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:24.602944 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:24.602944 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:24.602944 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:24.602944 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:24.602944 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 302/600] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:24.603886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba492f-5103-42fd-a806-59f0469cddcc None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:24.647802 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b462f2-e1e5-49a0-8633-d26e328954b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:24.648869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b462f2-e1e5-49a0-8633-d26e328954b9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:24.649521 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b462f2-e1e5-49a0-8633-d26e328954b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:24.650128 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4b462f2-e1e5-49a0-8633-d26e328954b9 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:24.651109 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b462f2-e1e5-49a0-8633-d26e328954b9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:24.651916 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b462f2-e1e5-49a0-8633-d26e328954b9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:24.654188 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4b462f2-e1e5-49a0-8633-d26e328954b9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:24.672124 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 299/601] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:24 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:24.674113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b462f2-e1e5-49a0-8633-d26e328954b9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:24.728083 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:24.759089 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcba492f-5103-42fd-a806-59f0469cddcc None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:24.771438 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:24.815007 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e0145-e2c4-4ed9-9314-71368165e548 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:24.816789 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e0145-e2c4-4ed9-9314-71368165e548 None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:24.816789 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e0145-e2c4-4ed9-9314-71368165e548 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:24.817291 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-148e0145-e2c4-4ed9-9314-71368165e548 None admin] PATH_INFO: `/v3/projects/838e996d09a0454b9bcdc5aef03ef203/users/77362a2134af4ede855882c58f40c472/roles/b549ba322af24099825f8949d2060adf` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:24.846142 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e0145-e2c4-4ed9-9314-71368165e548 None admin] RBAC: Authorizing `identity:create_grant(project_id=838e996d09a0454b9bcdc5aef03ef203, user_id=77362a2134af4ede855882c58f40c472, role_id=b549ba322af24099825f8949d2060adf)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:24.848617 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-148e0145-e2c4-4ed9-9314-71368165e548 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:24.862368 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4b462f2-e1e5-49a0-8633-d26e328954b9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:24.877555 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 303/602] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 21 00:52:24 2022] PUT /identity/v3/projects/838e996d09a0454b9bcdc5aef03ef203/users/77362a2134af4ede855882c58f40c472/roles/b549ba322af24099825f8949d2060adf => generated 0 bytes in 270 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:52:24.879624 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e0145-e2c4-4ed9-9314-71368165e548 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:24.925784 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43feca-d42e-4369-abb1-2082e5fb944d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:24.926833 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43feca-d42e-4369-abb1-2082e5fb944d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:24.927431 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43feca-d42e-4369-abb1-2082e5fb944d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:24.928048 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b43feca-d42e-4369-abb1-2082e5fb944d None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:24.929600 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43feca-d42e-4369-abb1-2082e5fb944d None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:24.930191 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43feca-d42e-4369-abb1-2082e5fb944d None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:24.932389 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b43feca-d42e-4369-abb1-2082e5fb944d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:24.951332 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 300/603] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:24 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:24.960771 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43feca-d42e-4369-abb1-2082e5fb944d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:25.140460 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-148e0145-e2c4-4ed9-9314-71368165e548 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:25.150776 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:25.211252 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b43feca-d42e-4369-abb1-2082e5fb944d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:25.220470 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c380c-48f4-4354-a628-e09fc7991289 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:25.221246 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c380c-48f4-4354-a628-e09fc7991289 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:25.221596 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c380c-48f4-4354-a628-e09fc7991289 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:25.221843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b4c380c-48f4-4354-a628-e09fc7991289 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:25.250703 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c380c-48f4-4354-a628-e09fc7991289 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:25.255857 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b4c380c-48f4-4354-a628-e09fc7991289 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:25.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-6b4c380c-48f4-4354-a628-e09fc7991289 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:25.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:25.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:25.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:25.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:25.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:25.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:25.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:25.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:25.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:25.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:25.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:25.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:25.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:25.280421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:25.282165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:25.282165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:25.282165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:25.282165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:25.282165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:25.282165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:25.282165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:25.282165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:25.282165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:25.282165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:25.282165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:25.282165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:25.282165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:25.282165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:25.282165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:25.282165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:25.282165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:25.283843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:25.283843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:25.283843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:25.283843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:25.283843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:25.283843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:25.283843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:25.283843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:25.285343 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 304/604] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:24 2022] GET /identity/v3/projects/service => generated 88 bytes in 406 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:25.292959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c380c-48f4-4354-a628-e09fc7991289 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:25.341436 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:25.348826 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b7eb1-7b2a-4420-8205-77d0c7e15373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:25.350528 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b7eb1-7b2a-4420-8205-77d0c7e15373 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:25.351360 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b7eb1-7b2a-4420-8205-77d0c7e15373 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:25.352175 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d05b7eb1-7b2a-4420-8205-77d0c7e15373 None admin] PATH_INFO: `/v3/projects/838e996d09a0454b9bcdc5aef03ef203/users/67305d6f08d64f8ba39abe10bd4974c9/roles/b549ba322af24099825f8949d2060adf` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:25.393877 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b7eb1-7b2a-4420-8205-77d0c7e15373 None admin] RBAC: Authorizing `identity:create_grant(project_id=838e996d09a0454b9bcdc5aef03ef203, user_id=67305d6f08d64f8ba39abe10bd4974c9, role_id=b549ba322af24099825f8949d2060adf)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:25.397197 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d05b7eb1-7b2a-4420-8205-77d0c7e15373 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:25.431035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 301/605] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 21 00:52:24 2022] PUT /identity/v3/projects/838e996d09a0454b9bcdc5aef03ef203/users/67305d6f08d64f8ba39abe10bd4974c9/roles/b549ba322af24099825f8949d2060adf => generated 0 bytes in 471 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 00:52:25.538036 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b4c380c-48f4-4354-a628-e09fc7991289 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:25.615523 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e0dd63c-d494-4371-bda0-be3a8834285f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:25.617112 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dd63c-d494-4371-bda0-be3a8834285f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:25.617939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dd63c-d494-4371-bda0-be3a8834285f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:25.618719 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e0dd63c-d494-4371-bda0-be3a8834285f None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:25.620806 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0dd63c-d494-4371-bda0-be3a8834285f None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:25.621767 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0dd63c-d494-4371-bda0-be3a8834285f None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:25.624940 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e0dd63c-d494-4371-bda0-be3a8834285f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:25.651141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 305/606] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:25 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 359 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:25.659757 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b7eb1-7b2a-4420-8205-77d0c7e15373 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:25.808295 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28e560-ee0a-415e-ace3-7116d34c1ebf None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:25.808569 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28e560-ee0a-415e-ace3-7116d34c1ebf None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:25.808920 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc28e560-ee0a-415e-ace3-7116d34c1ebf None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:25.810392 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 306/607] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:52:25.818184 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e530812-61a4-465e-8698-c482c71c5118 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:25.818448 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e530812-61a4-465e-8698-c482c71c5118 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:25.818808 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e530812-61a4-465e-8698-c482c71c5118 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:25.856171 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-6e530812-61a4-465e-8698-c482c71c5118 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:25.858994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-6e530812-61a4-465e-8698-c482c71c5118 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:25.867484 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d05b7eb1-7b2a-4420-8205-77d0c7e15373 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:25.915893 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7301aed7-53af-4b45-a21c-9076e49ef3a2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:25.916487 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301aed7-53af-4b45-a21c-9076e49ef3a2 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:25.916752 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301aed7-53af-4b45-a21c-9076e49ef3a2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:25.917024 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7301aed7-53af-4b45-a21c-9076e49ef3a2 None admin] PATH_INFO: `/v3/projects/838e996d09a0454b9bcdc5aef03ef203/users/78c29816db2d4193b293a0f94b4d1a01/roles/b549ba322af24099825f8949d2060adf` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:25.924670 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:25.966604 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301aed7-53af-4b45-a21c-9076e49ef3a2 None admin] RBAC: Authorizing `identity:create_grant(project_id=838e996d09a0454b9bcdc5aef03ef203, user_id=78c29816db2d4193b293a0f94b4d1a01, role_id=b549ba322af24099825f8949d2060adf)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:25.968084 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7301aed7-53af-4b45-a21c-9076e49ef3a2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:25.996026 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 302/608] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 21 00:52:25 2022] PUT /identity/v3/projects/838e996d09a0454b9bcdc5aef03ef203/users/78c29816db2d4193b293a0f94b4d1a01/roles/b549ba322af24099825f8949d2060adf => generated 0 bytes in 337 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:52:26.012249 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02d305-bd3c-47ed-b699-a0f5ac886028 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:26.012527 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02d305-bd3c-47ed-b699-a0f5ac886028 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:26.012862 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b02d305-bd3c-47ed-b699-a0f5ac886028 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:26.014664 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 303/609] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:26 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:52:26.025091 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0d08a-fff2-46ac-bab1-00c1e8d405af None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:26.025091 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0d08a-fff2-46ac-bab1-00c1e8d405af None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:26.025091 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9c0d08a-fff2-46ac-bab1-00c1e8d405af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:26.028015 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 307/610] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:25 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:52:26.058513 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-b9c0d08a-fff2-46ac-bab1-00c1e8d405af None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:26.059740 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b9c0d08a-fff2-46ac-bab1-00c1e8d405af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:26.166819 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 304/611] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:26 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:52:26.565768 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e530812-61a4-465e-8698-c482c71c5118 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:26.582397 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:26.777664 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0d08a-fff2-46ac-bab1-00c1e8d405af None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:26.822365 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e530812-61a4-465e-8698-c482c71c5118 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:26.974246 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc29b36-7997-4f63-af2e-6c53bbf64485 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:26.975278 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc29b36-7997-4f63-af2e-6c53bbf64485 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:26.975712 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc29b36-7997-4f63-af2e-6c53bbf64485 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:26.976136 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc29b36-7997-4f63-af2e-6c53bbf64485 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:26.999963 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9c0d08a-fff2-46ac-bab1-00c1e8d405af None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:27.022624 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc29b36-7997-4f63-af2e-6c53bbf64485 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:27.031443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-acc29b36-7997-4f63-af2e-6c53bbf64485 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:27.031443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:27.031443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:27.031443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:27.031443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:27.031443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:27.031443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:27.031443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:27.031443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:27.031443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:27.031443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:27.031443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:27.031443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:27.031443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:27.031443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:27.031443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:27.033242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:27.033242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:27.033242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:27.033242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:27.033242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:27.033242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:27.033242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:27.033242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:27.033242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:27.033242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:27.033242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:27.033242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:27.033242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:27.033242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:27.033242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:27.033242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:27.034886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:27.034886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:27.034886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:27.034886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:27.034886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:27.034886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:27.034886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:27.034886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:27.034886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:27.034886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:27.034886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:27.034886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:27.036125 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:27.045947 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 308/612] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 481 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:27.055625 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc29b36-7997-4f63-af2e-6c53bbf64485 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:27.080125 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8c38e-228d-49ef-a9da-aee47a803f3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:27.081101 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8c38e-228d-49ef-a9da-aee47a803f3e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:27.081578 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8c38e-228d-49ef-a9da-aee47a803f3e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:27.082046 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5b8c38e-228d-49ef-a9da-aee47a803f3e None admin] PATH_INFO: `/v3/roles/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:27.118623 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5b8c38e-228d-49ef-a9da-aee47a803f3e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:27.137109 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-b5b8c38e-228d-49ef-a9da-aee47a803f3e None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:27.137109 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:27.137109 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:27.137109 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:27.137109 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:27.137109 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:27.137109 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:27.137109 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:27.137109 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:27.137109 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:27.137109 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:27.137109 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:27.137109 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:27.137109 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:27.137109 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:27.137109 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:27.138960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:27.138960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:27.138960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:27.138960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:27.138960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:27.138960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:27.138960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:27.138960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:27.138960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:27.138960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:27.138960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:27.138960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:27.138960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:27.138960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:27.138960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:27.138960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:27.140568 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:27.140568 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:27.140568 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:27.140568 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:27.140568 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:27.140568 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:27.140568 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:27.140568 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:27.140568 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:27.140568 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:27.140568 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:27.140568 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:27.147212 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 305/613] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:26 2022] GET /identity/v3/roles/service => generated 85 bytes in 369 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:27.155370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8c38e-228d-49ef-a9da-aee47a803f3e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:27.222519 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:27.297116 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc29b36-7997-4f63-af2e-6c53bbf64485 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:27.373938 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5fd1a5-a4a3-48d7-b93a-b090dcfc56fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:27.378836 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fd1a5-a4a3-48d7-b93a-b090dcfc56fb None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:27.379596 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fd1a5-a4a3-48d7-b93a-b090dcfc56fb None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:27.380278 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e5fd1a5-a4a3-48d7-b93a-b090dcfc56fb None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:27.381737 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5fd1a5-a4a3-48d7-b93a-b090dcfc56fb None admin] RBAC: Adding query filter params (name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:27.385243 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5fd1a5-a4a3-48d7-b93a-b090dcfc56fb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:27.388133 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e5fd1a5-a4a3-48d7-b93a-b090dcfc56fb None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:27.423423 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 309/614] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 369 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:27.429746 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5fd1a5-a4a3-48d7-b93a-b090dcfc56fb None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:27.527437 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5b8c38e-228d-49ef-a9da-aee47a803f3e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:27.607264 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f9082-9a9b-4da2-ba24-ba1e29c6faa8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:27.611530 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f9082-9a9b-4da2-ba24-ba1e29c6faa8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:27.612138 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f9082-9a9b-4da2-ba24-ba1e29c6faa8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:27.612612 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc4f9082-9a9b-4da2-ba24-ba1e29c6faa8 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:27.613986 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f9082-9a9b-4da2-ba24-ba1e29c6faa8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:27.615063 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f9082-9a9b-4da2-ba24-ba1e29c6faa8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:27.619745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc4f9082-9a9b-4da2-ba24-ba1e29c6faa8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:27.649094 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 306/615] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:27 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 494 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:27.658607 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f9082-9a9b-4da2-ba24-ba1e29c6faa8 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:27.757687 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:27.792524 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e5fd1a5-a4a3-48d7-b93a-b090dcfc56fb None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:27.905752 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:27.932328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473ab76-1e48-469b-a5d9-d93702702f39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:27.933568 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473ab76-1e48-469b-a5d9-d93702702f39 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:27.934064 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473ab76-1e48-469b-a5d9-d93702702f39 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:27.934552 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7473ab76-1e48-469b-a5d9-d93702702f39 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:27.948034 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc4f9082-9a9b-4da2-ba24-ba1e29c6faa8 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:27.978871 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473ab76-1e48-469b-a5d9-d93702702f39 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:27.981778 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7473ab76-1e48-469b-a5d9-d93702702f39 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:28.017148 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a8903-e8eb-43bb-8e1b-806cece960d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:28.024361 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a8903-e8eb-43bb-8e1b-806cece960d8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:28.024888 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a8903-e8eb-43bb-8e1b-806cece960d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:28.025424 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc9a8903-e8eb-43bb-8e1b-806cece960d8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:28.035623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-7473ab76-1e48-469b-a5d9-d93702702f39 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:28.035623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:28.035623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:28.035623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:28.035623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:28.035623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:28.035623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:28.035623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:28.035623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:28.035623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:28.035623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:28.035623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:28.035623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:28.035623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:28.035623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:28.035623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:28.037525 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:28.037525 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:28.037525 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:28.037525 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:28.037525 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:28.037525 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:28.037525 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:28.037525 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:28.037525 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:28.037525 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:28.037525 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:28.037525 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:28.037525 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:28.037525 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:28.037525 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:28.037525 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:28.037525 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:28.039245 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:28.039245 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:28.039245 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:28.049109 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 310/616] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 614 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:28.054731 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473ab76-1e48-469b-a5d9-d93702702f39 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:28.055835 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a8903-e8eb-43bb-8e1b-806cece960d8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:28.058644 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fc9a8903-e8eb-43bb-8e1b-806cece960d8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:28.094926 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-fc9a8903-e8eb-43bb-8e1b-806cece960d8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:28.094926 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:28.094926 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:28.094926 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:28.094926 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:28.094926 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:28.094926 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:28.094926 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:28.094926 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:28.094926 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:28.094926 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:28.094926 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:28.094926 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:28.094926 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:28.094926 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:28.094926 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:28.096737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:28.096737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:28.096737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:28.096737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:28.096737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:28.096737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:28.096737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:28.096737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:28.096737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:28.096737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:28.096737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:28.096737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:28.096737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:28.096737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:28.096737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:28.096737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:28.096737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:28.097999 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:28.097999 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:28.097999 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:28.097999 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 307/617] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 440 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:28.111696 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a8903-e8eb-43bb-8e1b-806cece960d8 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:28.427898 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7473ab76-1e48-469b-a5d9-d93702702f39 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:28.449189 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:28.496919 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc9a8903-e8eb-43bb-8e1b-806cece960d8 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:28.541265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02fef884-2d7e-4315-9c93-0e363c5ca7a6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:28.542494 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fef884-2d7e-4315-9c93-0e363c5ca7a6 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:28.543039 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fef884-2d7e-4315-9c93-0e363c5ca7a6 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:28.543361 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02fef884-2d7e-4315-9c93-0e363c5ca7a6 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:28.544633 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fef884-2d7e-4315-9c93-0e363c5ca7a6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:28.545158 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fef884-2d7e-4315-9c93-0e363c5ca7a6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:28.555793 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02fef884-2d7e-4315-9c93-0e363c5ca7a6 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:28.563992 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd864e-f4e9-4b37-86c5-64690f850bde None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:28.565567 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd864e-f4e9-4b37-86c5-64690f850bde None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:28.566233 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd864e-f4e9-4b37-86c5-64690f850bde None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:28.566900 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccfd864e-f4e9-4b37-86c5-64690f850bde None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:28.568211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd864e-f4e9-4b37-86c5-64690f850bde None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:28.568990 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd864e-f4e9-4b37-86c5-64690f850bde None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:28.571632 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccfd864e-f4e9-4b37-86c5-64690f850bde None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:28.586290 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 311/618] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 532 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:28.587717 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 308/619] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 477 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:28.588552 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096e8b2-8cd2-43a3-887d-25e95e8a6c30 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:28.595743 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096e8b2-8cd2-43a3-887d-25e95e8a6c30 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:28.596502 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1096e8b2-8cd2-43a3-887d-25e95e8a6c30 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:28.596877 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd864e-f4e9-4b37-86c5-64690f850bde None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:28.599521 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 312/620] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:28 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:28.600846 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096e8b2-8cd2-43a3-887d-25e95e8a6c30 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:28.691691 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:28.734658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccfd864e-f4e9-4b37-86c5-64690f850bde None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:28.798375 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1096e8b2-8cd2-43a3-887d-25e95e8a6c30 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:28.800801 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78b44442-c7f4-4e18-a4cf-37678cb430ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:28.803954 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b44442-c7f4-4e18-a4cf-37678cb430ae None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:28.804734 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b44442-c7f4-4e18-a4cf-37678cb430ae None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:28.805499 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78b44442-c7f4-4e18-a4cf-37678cb430ae None admin] PATH_INFO: `/v3/users/nova` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:28.818561 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b44442-c7f4-4e18-a4cf-37678cb430ae None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:28.820431 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78b44442-c7f4-4e18-a4cf-37678cb430ae None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:28.834501 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-78b44442-c7f4-4e18-a4cf-37678cb430ae None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:52:28.834501 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:28.834501 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:28.834501 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:28.834501 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:28.834501 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:28.834501 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:28.834501 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:28.834501 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:28.834501 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:28.834501 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:28.834501 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:28.834501 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:28.834501 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:28.834501 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:28.834501 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:28.836463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:28.836463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:28.836463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:28.836463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:28.836463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:28.836463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:28.836463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:28.836463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:28.836463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:28.836463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:28.836463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:28.836463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:28.836463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:28.836463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:28.836463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:28.836463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:28.836463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:28.836463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:28.845791 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:28.845791 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:28.845791 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:28.845791 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:28.845791 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:28.845791 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:28.845791 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:28.845791 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:28.845791 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:52:28.845791 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:28.845791 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 309/621] 10.222.0.49 () {56 vars in 1093 bytes} [Sun Aug 21 00:52:28 2022] GET /identity/v3/users/nova => generated 82 bytes in 242 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:28.845791 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c708e-cf10-428b-ac39-33f86286b684 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:28.845791 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c708e-cf10-428b-ac39-33f86286b684 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:28.847496 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aa1c708e-cf10-428b-ac39-33f86286b684 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:28.874009 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-aa1c708e-cf10-428b-ac39-33f86286b684 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:28.876714 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-aa1c708e-cf10-428b-ac39-33f86286b684 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:28.880216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5e60a-9b63-4517-803a-a0429dd3eafd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:28.881803 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:28.883605 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5e60a-9b63-4517-803a-a0429dd3eafd None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:28.884369 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5e60a-9b63-4517-803a-a0429dd3eafd None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:28.885225 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-28a5e60a-9b63-4517-803a-a0429dd3eafd None admin] PATH_INFO: `/v3/users/swift` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:28.903920 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5e60a-9b63-4517-803a-a0429dd3eafd None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:28.907472 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-28a5e60a-9b63-4517-803a-a0429dd3eafd None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:28.933323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-28a5e60a-9b63-4517-803a-a0429dd3eafd None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:52:28.933323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:28.933323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:28.933323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:28.933323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:28.933323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:28.933323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:28.933323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:28.933323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:28.933323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:28.933323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:28.933323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:28.933323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:28.933323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:28.933323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:28.933323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:28.935268 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:28.935268 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:28.935268 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:28.935268 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:28.935268 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:28.935268 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:28.935268 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:28.935268 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:28.935268 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:28.935268 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:28.935268 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:28.935268 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:28.935268 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:28.935268 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:28.935268 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:28.935268 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:28.935268 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:28.935268 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:28.937024 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:28.937024 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:28.937024 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:28.937024 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:28.937024 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:28.937024 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:28.937024 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:28.937024 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:28.937024 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:52:28.937024 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:28.940900 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 313/622] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:52:28 2022] GET /identity/v3/users/swift => generated 83 bytes in 341 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:28.942957 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5e60a-9b63-4517-803a-a0429dd3eafd None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:28.966570 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 310/623] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:28 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:28.966957 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c708e-cf10-428b-ac39-33f86286b684 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:29.100203 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aa1c708e-cf10-428b-ac39-33f86286b684 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:29.162312 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:29.169488 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-28a5e60a-9b63-4517-803a-a0429dd3eafd None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:29.170586 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98516871-1339-492f-8b0c-6e3680f6cf8f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:29.171688 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98516871-1339-492f-8b0c-6e3680f6cf8f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:29.172176 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98516871-1339-492f-8b0c-6e3680f6cf8f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:29.172658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98516871-1339-492f-8b0c-6e3680f6cf8f None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:29.174104 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98516871-1339-492f-8b0c-6e3680f6cf8f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:29.174634 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98516871-1339-492f-8b0c-6e3680f6cf8f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:29.178172 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98516871-1339-492f-8b0c-6e3680f6cf8f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:29.196143 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:29.218465 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 311/624] 10.222.0.49 () {56 vars in 1135 bytes} [Sun Aug 21 00:52:28 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:29.227786 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98516871-1339-492f-8b0c-6e3680f6cf8f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:29.251010 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d54b57-1dff-4ab7-b245-96d9c38853d3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:29.252477 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d54b57-1dff-4ab7-b245-96d9c38853d3 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:29.253251 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d54b57-1dff-4ab7-b245-96d9c38853d3 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:29.254063 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31d54b57-1dff-4ab7-b245-96d9c38853d3 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:29.255633 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d54b57-1dff-4ab7-b245-96d9c38853d3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:29.256389 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d54b57-1dff-4ab7-b245-96d9c38853d3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:29.259407 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31d54b57-1dff-4ab7-b245-96d9c38853d3 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:29.294997 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 314/625] 10.222.0.49 () {56 vars in 1133 bytes} [Sun Aug 21 00:52:28 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:29.304239 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d54b57-1dff-4ab7-b245-96d9c38853d3 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:29.384046 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98516871-1339-492f-8b0c-6e3680f6cf8f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:29.427151 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9d6a26-7219-424b-9fc9-b9bd62539ba4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:29.427853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d6a26-7219-424b-9fc9-b9bd62539ba4 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:29.428125 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d6a26-7219-424b-9fc9-b9bd62539ba4 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:29.428396 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9d6a26-7219-424b-9fc9-b9bd62539ba4 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:29.442861 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d6a26-7219-424b-9fc9-b9bd62539ba4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:29.444477 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec9d6a26-7219-424b-9fc9-b9bd62539ba4 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:29.468565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ec9d6a26-7219-424b-9fc9-b9bd62539ba4 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:29.468565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:29.468565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:29.468565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:29.468565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:29.468565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:29.468565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:29.468565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:29.468565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:29.468565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:29.468565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:29.468565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:29.468565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:29.468565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:29.468565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:29.468565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:29.469850 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:29.469850 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:29.469850 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:29.469850 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:29.469850 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:29.469850 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:29.469850 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:29.469850 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:29.469850 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:29.469850 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:29.469850 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:29.469850 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:29.469850 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:29.469850 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:29.469850 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:29.469850 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:29.469850 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:29.471262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:29.471262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:29.471262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:29.471262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 312/626] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:29 2022] GET /identity/v3/domains/Default => generated 87 bytes in 244 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:29.472836 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50baa48b-261f-47c6-9ac0-bee3f27c6c8f None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:29.473140 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50baa48b-261f-47c6-9ac0-bee3f27c6c8f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:29.473413 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-50baa48b-261f-47c6-9ac0-bee3f27c6c8f None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:29.474951 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 313/627] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:29.483442 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50baa48b-261f-47c6-9ac0-bee3f27c6c8f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:29.527563 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31d54b57-1dff-4ab7-b245-96d9c38853d3 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:29.589519 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:29.608191 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1c308-02fc-45df-932d-e3012c5bf047 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:29.609305 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1c308-02fc-45df-932d-e3012c5bf047 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:29.609993 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1c308-02fc-45df-932d-e3012c5bf047 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:29.610632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bb1c308-02fc-45df-932d-e3012c5bf047 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:29.672766 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:29.699395 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-50baa48b-261f-47c6-9ac0-bee3f27c6c8f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:29.759380 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1c308-02fc-45df-932d-e3012c5bf047 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:29.762315 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bb1c308-02fc-45df-932d-e3012c5bf047 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:29.765237 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dfa92e84-fbea-4c4e-93ff-6b041cf26c11 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:29.766288 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa92e84-fbea-4c4e-93ff-6b041cf26c11 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:29.766759 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa92e84-fbea-4c4e-93ff-6b041cf26c11 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:29.767251 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dfa92e84-fbea-4c4e-93ff-6b041cf26c11 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:29.768446 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa92e84-fbea-4c4e-93ff-6b041cf26c11 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:29.768965 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa92e84-fbea-4c4e-93ff-6b041cf26c11 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:29.771547 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dfa92e84-fbea-4c4e-93ff-6b041cf26c11 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:29.792654 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 314/628] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:29 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 313 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:29.795893 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de98ac9-a1ac-44a7-95c3-36b257a7267d None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:29.796370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de98ac9-a1ac-44a7-95c3-36b257a7267d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:29.796808 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9de98ac9-a1ac-44a7-95c3-36b257a7267d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:29.826617 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-9de98ac9-a1ac-44a7-95c3-36b257a7267d None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:29.828671 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9de98ac9-a1ac-44a7-95c3-36b257a7267d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:29.938506 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 315/629] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:29 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 635 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 21 00:52:29.940326 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1c308-02fc-45df-932d-e3012c5bf047 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:29.947870 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 315/630] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:29 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 155 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:29.949366 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de98ac9-a1ac-44a7-95c3-36b257a7267d None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:30.015600 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:30.053742 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:30.115674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9de98ac9-a1ac-44a7-95c3-36b257a7267d None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:30.129479 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bb1c308-02fc-45df-932d-e3012c5bf047 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:30.175744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58b61f15-d3e9-43bb-87ff-ddda1127dece None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:30.176648 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b61f15-d3e9-43bb-87ff-ddda1127dece None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:30.177203 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b61f15-d3e9-43bb-87ff-ddda1127dece None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:30.177552 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58b61f15-d3e9-43bb-87ff-ddda1127dece None admin] PATH_INFO: `/v3/roles/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:30.179822 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336f159-e1bc-4ad4-970c-f61388640c72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:30.180825 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336f159-e1bc-4ad4-970c-f61388640c72 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:30.181332 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336f159-e1bc-4ad4-970c-f61388640c72 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:30.181792 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e336f159-e1bc-4ad4-970c-f61388640c72 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:30.192093 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58b61f15-d3e9-43bb-87ff-ddda1127dece None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:30.194863 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336f159-e1bc-4ad4-970c-f61388640c72 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:30.197690 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e336f159-e1bc-4ad4-970c-f61388640c72 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:30.198117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-58b61f15-d3e9-43bb-87ff-ddda1127dece None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:30.198117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:30.198117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:30.198117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:30.198117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:30.198117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:30.198117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:30.198117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:30.198117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:30.198117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:30.198117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:30.198117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:30.198117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:30.198117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:30.198117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:30.198117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:30.199916 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:30.199916 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:30.199916 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:30.199916 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:30.199916 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:30.199916 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:30.199916 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:30.199916 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:30.199916 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:30.199916 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:30.199916 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:30.199916 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:30.199916 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:30.199916 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:30.199916 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:30.199916 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:30.201600 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:30.201600 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:30.201600 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:30.201600 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:30.201600 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:30.201600 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:30.201600 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:30.201600 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:30.201600 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:30.201600 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:30.201600 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:30.201600 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:30.204696 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 316/631] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:29 2022] GET /identity/v3/roles/service => generated 85 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:30.207118 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9779e1-82a6-427e-8a7f-22c15e1c32ec None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:30.207836 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9779e1-82a6-427e-8a7f-22c15e1c32ec None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:30.208494 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e9779e1-82a6-427e-8a7f-22c15e1c32ec None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:30.211147 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 317/632] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:30 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:30.212680 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9779e1-82a6-427e-8a7f-22c15e1c32ec None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:30.229082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-e336f159-e1bc-4ad4-970c-f61388640c72 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:30.229082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:30.229082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:30.229082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:30.229082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:30.229082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:30.229082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:30.229082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:30.229082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:30.229082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:30.229082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:30.229082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:30.229082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:30.229082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:30.229082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:30.230671 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:30.230671 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:30.230671 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:30.230671 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:30.230671 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:30.230671 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:30.230671 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:30.230671 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:30.230671 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:30.230671 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:30.230671 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:30.230671 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:30.230671 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:30.230671 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:30.230671 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:30.230671 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:30.230671 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:30.232224 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:30.232224 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:30.232224 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:30.232224 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:30.232224 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:30.232224 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:30.232224 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:30.232224 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:30.237542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 316/633] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:29 2022] GET /identity/v3/projects/service => generated 88 bytes in 289 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:30.239167 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336f159-e1bc-4ad4-970c-f61388640c72 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:30.387648 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e9779e1-82a6-427e-8a7f-22c15e1c32ec None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:30.421106 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:30.424200 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:30.425975 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e336f159-e1bc-4ad4-970c-f61388640c72 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:30.453315 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1b49d9-1d28-45ad-957c-c0e4c9808d2e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:30.453966 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b49d9-1d28-45ad-957c-c0e4c9808d2e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:30.454307 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b49d9-1d28-45ad-957c-c0e4c9808d2e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:30.454635 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1b49d9-1d28-45ad-957c-c0e4c9808d2e None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:30.467149 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b49d9-1d28-45ad-957c-c0e4c9808d2e None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:30.468791 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1b49d9-1d28-45ad-957c-c0e4c9808d2e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:30.487822 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392df7d-73b0-438d-90c2-d6edfeb7eaf6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:30.488778 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392df7d-73b0-438d-90c2-d6edfeb7eaf6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:30.489272 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392df7d-73b0-438d-90c2-d6edfeb7eaf6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:30.489718 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2392df7d-73b0-438d-90c2-d6edfeb7eaf6 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:30.490828 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392df7d-73b0-438d-90c2-d6edfeb7eaf6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:30.491319 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392df7d-73b0-438d-90c2-d6edfeb7eaf6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:30.493562 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-8a1b49d9-1d28-45ad-957c-c0e4c9808d2e None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:30.493562 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:30.493562 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:30.493562 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:30.493562 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:30.493562 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:30.493562 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:30.493562 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:30.493562 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:30.493562 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:30.493562 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:30.493562 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:30.493562 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:30.493562 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:30.493562 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:30.493562 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:30.495476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:30.495476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:30.495476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:30.495476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:30.495476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:30.495476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:30.495476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:30.495476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:30.495476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:30.495476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:30.495476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:30.495476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:30.495476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:30.495476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:30.495476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:30.495476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:30.495476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:30.497267 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:30.497267 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:30.497267 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:30.497602 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2392df7d-73b0-438d-90c2-d6edfeb7eaf6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:30.497761 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 318/634] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:30.497761 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cad0d-63a2-40b9-9ae9-64da9f35481e None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:30.497761 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cad0d-63a2-40b9-9ae9-64da9f35481e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:30.497761 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-520cad0d-63a2-40b9-9ae9-64da9f35481e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:30.514646 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 317/635] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:30 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 277 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:30.516627 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392df7d-73b0-438d-90c2-d6edfeb7eaf6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:30.522653 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-520cad0d-63a2-40b9-9ae9-64da9f35481e None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:30.523994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-520cad0d-63a2-40b9-9ae9-64da9f35481e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:30.644961 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2392df7d-73b0-438d-90c2-d6edfeb7eaf6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:30.648037 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 319/636] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:30 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:30.649211 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cad0d-63a2-40b9-9ae9-64da9f35481e None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:30.704979 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6715f8-76ad-4ec4-a339-aef3921287c0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:30.705938 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6715f8-76ad-4ec4-a339-aef3921287c0 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:30.706414 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6715f8-76ad-4ec4-a339-aef3921287c0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:30.706896 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd6715f8-76ad-4ec4-a339-aef3921287c0 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:30.708193 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6715f8-76ad-4ec4-a339-aef3921287c0 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:30.708731 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6715f8-76ad-4ec4-a339-aef3921287c0 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:30.711533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd6715f8-76ad-4ec4-a339-aef3921287c0 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:30.734059 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 318/637] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:30 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:30.735426 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6715f8-76ad-4ec4-a339-aef3921287c0 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:30.782773 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:30.866715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:30.872905 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-520cad0d-63a2-40b9-9ae9-64da9f35481e None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:30.935726 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd6715f8-76ad-4ec4-a339-aef3921287c0 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:30.949521 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5a355-b387-4ae4-ba1f-a7c75b891e5f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:30.950591 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5a355-b387-4ae4-ba1f-a7c75b891e5f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:30.950953 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5a355-b387-4ae4-ba1f-a7c75b891e5f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:30.951424 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f5a355-b387-4ae4-ba1f-a7c75b891e5f None admin] PATH_INFO: `/v3/roles/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:30.971385 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-95f5a355-b387-4ae4-ba1f-a7c75b891e5f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:30.980873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-95f5a355-b387-4ae4-ba1f-a7c75b891e5f None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:30.980873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:30.980873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:30.980873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:30.980873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:30.980873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:30.980873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:30.980873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:30.980873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:30.980873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:30.980873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:30.980873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:30.980873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:30.980873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:30.980873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:30.980873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:30.985406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:30.985406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:30.985406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:30.985406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:30.985406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:30.985406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:30.985406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:30.985406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:30.985406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:30.985406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:30.985406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:30.985406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:30.985406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:30.985406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:30.985406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:30.985406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:30.987128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:30.987128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:30.987128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:30.987128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:30.987128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:30.987128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:30.987128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:30.987128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:30.987128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:30.987128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:30.987128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:30.987128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:30.987128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 320/638] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:30 2022] GET /identity/v3/roles/service => generated 85 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:30.987128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5a355-b387-4ae4-ba1f-a7c75b891e5f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:31.020398 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd95dd-9246-4ee9-8e91-b8f4aa6c20d7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:31.021546 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd95dd-9246-4ee9-8e91-b8f4aa6c20d7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:31.022038 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd95dd-9246-4ee9-8e91-b8f4aa6c20d7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:31.022530 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddfd95dd-9246-4ee9-8e91-b8f4aa6c20d7 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:31.023745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd95dd-9246-4ee9-8e91-b8f4aa6c20d7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:31.024294 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd95dd-9246-4ee9-8e91-b8f4aa6c20d7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:31.027074 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddfd95dd-9246-4ee9-8e91-b8f4aa6c20d7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:31.050551 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 319/639] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:30 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:31.052075 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd95dd-9246-4ee9-8e91-b8f4aa6c20d7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:31.187602 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f5a355-b387-4ae4-ba1f-a7c75b891e5f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:31.208487 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:31.246798 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddfd95dd-9246-4ee9-8e91-b8f4aa6c20d7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:31.266377 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dfb0b-97bb-4270-aa68-55fc188e4104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:31.267142 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dfb0b-97bb-4270-aa68-55fc188e4104 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:31.267487 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dfb0b-97bb-4270-aa68-55fc188e4104 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:31.267829 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-384dfb0b-97bb-4270-aa68-55fc188e4104 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:31.280835 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dfb0b-97bb-4270-aa68-55fc188e4104 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:31.282670 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-384dfb0b-97bb-4270-aa68-55fc188e4104 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:31.301717 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-384dfb0b-97bb-4270-aa68-55fc188e4104 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:31.301717 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:31.301717 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:31.301717 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:31.301717 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:31.301717 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:31.301717 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:31.301717 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:31.301717 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:31.301717 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:31.301717 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:31.301717 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:31.301717 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:31.301717 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:31.301717 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:31.301717 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:31.303641 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:31.303641 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:31.303641 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:31.303641 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:31.303641 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:31.303641 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:31.303641 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:31.303641 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:31.303641 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:31.303641 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:31.303641 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:31.303641 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:31.303641 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:31.303641 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:31.303641 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:31.303641 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:31.303641 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:31.305423 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:31.305423 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:31.305423 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:31.305423 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 321/640] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:30 2022] GET /identity/v3/domains/Default => generated 87 bytes in 319 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:31.305423 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dfb0b-97bb-4270-aa68-55fc188e4104 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:31.323748 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde3571-3cc0-4273-bc24-755f6b27fc3e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:31.324897 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde3571-3cc0-4273-bc24-755f6b27fc3e None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:31.325431 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde3571-3cc0-4273-bc24-755f6b27fc3e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:31.325918 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfde3571-3cc0-4273-bc24-755f6b27fc3e None admin] PATH_INFO: `/v3/projects/838e996d09a0454b9bcdc5aef03ef203/users/f66a877fdca340f48f54b48e5367a194/roles/b549ba322af24099825f8949d2060adf` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:31.330363 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:31.347738 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde3571-3cc0-4273-bc24-755f6b27fc3e None admin] RBAC: Authorizing `identity:create_grant(project_id=838e996d09a0454b9bcdc5aef03ef203, user_id=f66a877fdca340f48f54b48e5367a194, role_id=b549ba322af24099825f8949d2060adf)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:31.349807 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cfde3571-3cc0-4273-bc24-755f6b27fc3e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:31.365791 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 320/641] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 21 00:52:31 2022] PUT /identity/v3/projects/838e996d09a0454b9bcdc5aef03ef203/users/f66a877fdca340f48f54b48e5367a194/roles/b549ba322af24099825f8949d2060adf => generated 0 bytes in 315 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:52:31.366873 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde3571-3cc0-4273-bc24-755f6b27fc3e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:31.485687 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-384dfb0b-97bb-4270-aa68-55fc188e4104 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:31.542748 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea190be-26e4-4a8d-9ff8-f5e8e16004ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:31.543542 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea190be-26e4-4a8d-9ff8-f5e8e16004ef None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:31.543959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea190be-26e4-4a8d-9ff8-f5e8e16004ef None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:31.544308 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfde3571-3cc0-4273-bc24-755f6b27fc3e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:31.544479 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ea190be-26e4-4a8d-9ff8-f5e8e16004ef None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:31.545314 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea190be-26e4-4a8d-9ff8-f5e8e16004ef None admin] RBAC: Adding query filter params (name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:31.545762 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea190be-26e4-4a8d-9ff8-f5e8e16004ef None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:31.547704 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ea190be-26e4-4a8d-9ff8-f5e8e16004ef None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:31.563052 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 322/642] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 259 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:31.564548 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea190be-26e4-4a8d-9ff8-f5e8e16004ef None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:31.603204 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:31.614723 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9efb2-628b-4302-98de-71eb2c2656db None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:31.615809 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9efb2-628b-4302-98de-71eb2c2656db None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:31.616303 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9efb2-628b-4302-98de-71eb2c2656db None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:31.616779 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63d9efb2-628b-4302-98de-71eb2c2656db None admin] PATH_INFO: `/v3/roles/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:31.638562 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63d9efb2-628b-4302-98de-71eb2c2656db None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:31.648746 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-63d9efb2-628b-4302-98de-71eb2c2656db None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:31.648746 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:31.648746 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:31.648746 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:31.648746 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:31.648746 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:31.648746 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:31.648746 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:31.648746 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:31.648746 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:31.648746 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:31.648746 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:31.648746 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:31.648746 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:31.648746 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:31.648746 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:31.651372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:31.651372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:31.651372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:31.651372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:31.651372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:31.651372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:31.651372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:31.651372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:31.651372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:31.651372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:31.651372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:31.651372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:31.651372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:31.651372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:31.651372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:31.651372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:31.653032 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:31.653032 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:31.653032 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:31.653032 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:31.653032 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:31.653032 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:31.653032 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:31.653032 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:31.653032 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:31.653032 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:31.653032 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:31.653032 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:31.653032 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 321/643] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:31 2022] GET /identity/v3/roles/service => generated 85 bytes in 283 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:31.653032 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9efb2-628b-4302-98de-71eb2c2656db None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:31.744265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:31.792844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ea190be-26e4-4a8d-9ff8-f5e8e16004ef None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:31.829292 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63d9efb2-628b-4302-98de-71eb2c2656db None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:31.856711 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e4aec-8b6d-4cb2-a67d-526303283274 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:31.858331 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e4aec-8b6d-4cb2-a67d-526303283274 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:31.859113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e4aec-8b6d-4cb2-a67d-526303283274 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:31.859762 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d07e4aec-8b6d-4cb2-a67d-526303283274 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:31.872721 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e4aec-8b6d-4cb2-a67d-526303283274 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:31.875855 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d07e4aec-8b6d-4cb2-a67d-526303283274 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:31.878320 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b545e-5a1f-4dc5-b111-428b720ed41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:31.879259 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b545e-5a1f-4dc5-b111-428b720ed41d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:31.879660 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b545e-5a1f-4dc5-b111-428b720ed41d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:31.880056 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-499b545e-5a1f-4dc5-b111-428b720ed41d None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:31.881154 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b545e-5a1f-4dc5-b111-428b720ed41d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:31.881623 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b545e-5a1f-4dc5-b111-428b720ed41d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:31.883184 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-499b545e-5a1f-4dc5-b111-428b720ed41d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:31.898439 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-d07e4aec-8b6d-4cb2-a67d-526303283274 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:31.898439 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:31.898439 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:31.898439 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:31.898439 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:31.898439 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:31.898439 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:31.898439 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:31.898439 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:31.898439 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:31.898439 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:31.898439 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:31.898439 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:31.898439 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:31.898439 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:31.908316 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:31.908316 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:31.908316 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:31.908316 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:31.908316 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:31.908316 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:31.908316 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:31.908316 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:31.908316 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:31.908316 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:31.908316 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:31.908316 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:31.908316 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:31.908316 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:31.908316 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:31.908316 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:31.908316 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:31.910738 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:31.910738 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:31.910738 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:31.910738 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:31.910738 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:31.910738 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:31.910738 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:31.910738 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:31.911590 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 322/645] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:31 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 256 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:31.911737 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 323/645] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:31 2022] GET /identity/v3/projects/service => generated 88 bytes in 342 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:31.911865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b545e-5a1f-4dc5-b111-428b720ed41d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:31.912004 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e4aec-8b6d-4cb2-a67d-526303283274 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:31.989896 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:32.089097 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d07e4aec-8b6d-4cb2-a67d-526303283274 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:32.090047 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-499b545e-5a1f-4dc5-b111-428b720ed41d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:32.153869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dbec0-2f05-47aa-8616-eb601162d6e5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:32.154917 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dbec0-2f05-47aa-8616-eb601162d6e5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:32.155385 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dbec0-2f05-47aa-8616-eb601162d6e5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:32.155842 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5d8dbec0-2f05-47aa-8616-eb601162d6e5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:32.157292 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba056614-b91d-41c2-8d41-55827a3ef5ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:32.158173 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba056614-b91d-41c2-8d41-55827a3ef5ed None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:32.158580 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba056614-b91d-41c2-8d41-55827a3ef5ed None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:32.158872 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba056614-b91d-41c2-8d41-55827a3ef5ed None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:32.159676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba056614-b91d-41c2-8d41-55827a3ef5ed None admin] RBAC: Adding query filter params (name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:32.160059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba056614-b91d-41c2-8d41-55827a3ef5ed None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:32.161516 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba056614-b91d-41c2-8d41-55827a3ef5ed None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:32.164121 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:32.175718 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8dbec0-2f05-47aa-8616-eb601162d6e5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:32.177967 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5d8dbec0-2f05-47aa-8616-eb601162d6e5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:32.179360 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 324/646] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:31 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 272 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:32.180288 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba056614-b91d-41c2-8d41-55827a3ef5ed None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:32.212628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-5d8dbec0-2f05-47aa-8616-eb601162d6e5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:32.212628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:32.212628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:32.212628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:32.212628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:32.212628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:32.212628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:32.212628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:32.212628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:32.212628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:32.212628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:32.212628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:32.212628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:32.212628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:32.212628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:32.212628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:32.214626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:32.214626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:32.214626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:32.214626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:32.214626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:32.214626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:32.214626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:32.214626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:32.214626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:32.214626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:32.214626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:32.214626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:32.214626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:32.214626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:32.214626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:32.214626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:32.214626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:32.215885 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:32.215885 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:32.215885 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:32.221795 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 323/647] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:31 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:32.222688 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dbec0-2f05-47aa-8616-eb601162d6e5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:32.374679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba056614-b91d-41c2-8d41-55827a3ef5ed None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:32.410379 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5d8dbec0-2f05-47aa-8616-eb601162d6e5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:32.415310 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:32.442382 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babcafe6-cf08-4147-9220-aca11aad7d10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:32.443723 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcafe6-cf08-4147-9220-aca11aad7d10 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:32.444098 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcafe6-cf08-4147-9220-aca11aad7d10 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:32.444380 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-babcafe6-cf08-4147-9220-aca11aad7d10 None admin] PATH_INFO: `/v3/users/glance` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:32.456107 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babcafe6-cf08-4147-9220-aca11aad7d10 None admin] RBAC: Authorizing `identity:get_user(user_id=glance)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:32.458314 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-babcafe6-cf08-4147-9220-aca11aad7d10 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:32.475959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-babcafe6-cf08-4147-9220-aca11aad7d10 None admin] Could not find user: glance.: keystone.exception.UserNotFound: Could not find user: glance. Aug 21 00:52:32.475959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:32.475959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:32.475959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:32.475959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:32.475959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:32.475959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:32.475959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:32.475959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:32.475959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:32.475959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:32.475959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:32.475959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:32.475959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:32.475959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:32.475959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:32.485451 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:32.485451 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:32.485451 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:32.485451 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:32.485451 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:32.485451 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:32.485451 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:32.485451 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:32.485451 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:32.485451 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:32.485451 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:32.485451 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:32.485451 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:32.485451 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:32.485451 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:32.485451 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:32.485451 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:32.485451 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:32.487443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:32.487443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:32.487443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:32.487443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:32.487443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:32.487443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:32.487443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:32.487443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:32.487443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance. Aug 21 00:52:32.487443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:32.487443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 325/648] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:52:32 2022] GET /identity/v3/users/glance => generated 84 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:32.487443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babcafe6-cf08-4147-9220-aca11aad7d10 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:32.491367 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3678dbb-2778-4155-99e1-23620edaa6bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:32.492387 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3678dbb-2778-4155-99e1-23620edaa6bd None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:32.492832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3678dbb-2778-4155-99e1-23620edaa6bd None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:32.493307 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3678dbb-2778-4155-99e1-23620edaa6bd None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:32.494549 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3678dbb-2778-4155-99e1-23620edaa6bd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:32.495043 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3678dbb-2778-4155-99e1-23620edaa6bd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:32.497758 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3678dbb-2778-4155-99e1-23620edaa6bd None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:32.524585 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 324/649] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:32 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:32.525999 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3678dbb-2778-4155-99e1-23620edaa6bd None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:32.588693 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:32.676131 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-babcafe6-cf08-4147-9220-aca11aad7d10 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:32.731786 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3678dbb-2778-4155-99e1-23620edaa6bd None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:32.734420 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36157868-877a-4799-942c-f186cb8dc866 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:32.735138 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36157868-877a-4799-942c-f186cb8dc866 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:32.735431 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36157868-877a-4799-942c-f186cb8dc866 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:32.735707 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36157868-877a-4799-942c-f186cb8dc866 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:32.756568 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36157868-877a-4799-942c-f186cb8dc866 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:32.759525 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36157868-877a-4799-942c-f186cb8dc866 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:32.789676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-36157868-877a-4799-942c-f186cb8dc866 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:32.789676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:32.789676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:32.789676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:32.789676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:32.789676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:32.789676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:32.789676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:32.789676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:32.789676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:32.789676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:32.789676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:32.789676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:32.789676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:32.789676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:32.789676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:32.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:32.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:32.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:32.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:32.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:32.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:32.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:32.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:32.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:32.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:32.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:32.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:32.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:32.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:32.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:32.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:32.791679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:32.793474 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:32.793474 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:32.793474 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:32.793474 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 326/650] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:32 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:32.793474 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36157868-877a-4799-942c-f186cb8dc866 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:32.807490 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3109e6e-6fa6-444c-9906-0ca6a02b8e7c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:32.809091 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3109e6e-6fa6-444c-9906-0ca6a02b8e7c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:32.810680 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3109e6e-6fa6-444c-9906-0ca6a02b8e7c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:32.811444 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3109e6e-6fa6-444c-9906-0ca6a02b8e7c None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:32.812878 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3109e6e-6fa6-444c-9906-0ca6a02b8e7c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:32.814476 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3109e6e-6fa6-444c-9906-0ca6a02b8e7c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:32.818144 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b3109e6e-6fa6-444c-9906-0ca6a02b8e7c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:32.840834 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 325/651] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:32 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:32.842690 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3109e6e-6fa6-444c-9906-0ca6a02b8e7c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:32.894479 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:32.995676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36157868-877a-4799-942c-f186cb8dc866 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:33.014219 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:33.045354 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3109e6e-6fa6-444c-9906-0ca6a02b8e7c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:33.059154 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324fa4c-ef02-449c-a4fe-e126aabe42ed None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:33.060118 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324fa4c-ef02-449c-a4fe-e126aabe42ed None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:33.060558 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324fa4c-ef02-449c-a4fe-e126aabe42ed None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:33.060986 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2324fa4c-ef02-449c-a4fe-e126aabe42ed None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:33.062184 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324fa4c-ef02-449c-a4fe-e126aabe42ed None admin] RBAC: Adding query filter params (domain_id=default, name=glance) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:33.062675 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324fa4c-ef02-449c-a4fe-e126aabe42ed None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:33.065223 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2324fa4c-ef02-449c-a4fe-e126aabe42ed None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:33.096412 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 327/652] 10.222.0.49 () {56 vars in 1137 bytes} [Sun Aug 21 00:52:32 2022] GET /identity/v3/users?domain_id=default&name=glance => generated 372 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:33.097929 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324fa4c-ef02-449c-a4fe-e126aabe42ed None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:33.112036 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6fe60-d42b-4bc3-9e1e-6711931f6982 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:33.112989 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6fe60-d42b-4bc3-9e1e-6711931f6982 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:33.113464 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6fe60-d42b-4bc3-9e1e-6711931f6982 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:33.114015 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8b6fe60-d42b-4bc3-9e1e-6711931f6982 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:33.115185 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6fe60-d42b-4bc3-9e1e-6711931f6982 None admin] RBAC: Adding query filter params (role.id=b549ba322af24099825f8949d2060adf, scope.project.id=838e996d09a0454b9bcdc5aef03ef203, user.id=6b003ae4a082485ab608bf84c1657159) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:33.115752 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6fe60-d42b-4bc3-9e1e-6711931f6982 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:33.118427 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b8b6fe60-d42b-4bc3-9e1e-6711931f6982 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:33.137337 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 326/653] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:32 2022] GET /identity/v3/role_assignments?user.id=6b003ae4a082485ab608bf84c1657159&scope.project.id=838e996d09a0454b9bcdc5aef03ef203&role.id=b549ba322af24099825f8949d2060adf => generated 608 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:33.138429 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6fe60-d42b-4bc3-9e1e-6711931f6982 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:33.327346 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:33.327603 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2324fa4c-ef02-449c-a4fe-e126aabe42ed None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:33.355286 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8b6fe60-d42b-4bc3-9e1e-6711931f6982 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:33.407746 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b66c2-ff11-4e60-a6a8-a1f962293ff4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:33.408731 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b66c2-ff11-4e60-a6a8-a1f962293ff4 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:33.409233 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b66c2-ff11-4e60-a6a8-a1f962293ff4 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:33.409685 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-420b66c2-ff11-4e60-a6a8-a1f962293ff4 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:33.410801 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b66c2-ff11-4e60-a6a8-a1f962293ff4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:33.411433 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b66c2-ff11-4e60-a6a8-a1f962293ff4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:33.413974 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-420b66c2-ff11-4e60-a6a8-a1f962293ff4 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:33.425659 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00a595-3ac0-4050-9d0f-6aa27f033016 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:33.426661 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00a595-3ac0-4050-9d0f-6aa27f033016 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:33.427911 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00a595-3ac0-4050-9d0f-6aa27f033016 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:33.428362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e00a595-3ac0-4050-9d0f-6aa27f033016 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:33.438852 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 328/654] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:33.442557 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b66c2-ff11-4e60-a6a8-a1f962293ff4 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:33.444690 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00a595-3ac0-4050-9d0f-6aa27f033016 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:33.447198 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e00a595-3ac0-4050-9d0f-6aa27f033016 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:33.465283 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-2e00a595-3ac0-4050-9d0f-6aa27f033016 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 00:52:33.465283 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:33.465283 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:33.465283 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:33.465283 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:33.465283 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:33.465283 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:33.465283 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:33.465283 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:33.465283 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:33.465283 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:33.465283 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:33.465283 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:33.465283 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:33.465283 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:33.465283 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:33.467098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:33.467098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:33.467098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:33.467098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:33.467098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:33.467098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:33.467098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:33.467098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:33.467098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:33.467098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:33.467098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:33.467098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:33.467098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:33.467098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:33.467098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:33.467098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:33.467098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:33.467098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:33.468935 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:33.468935 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:33.468935 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:33.468935 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:33.468935 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:33.468935 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:33.468935 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:33.468935 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:33.468935 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 00:52:33.468935 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:33.468935 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 327/655] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:52:33 2022] GET /identity/v3/users/cinder => generated 84 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:33.470019 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00a595-3ac0-4050-9d0f-6aa27f033016 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:33.507883 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:33.628533 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-420b66c2-ff11-4e60-a6a8-a1f962293ff4 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:33.663280 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e00a595-3ac0-4050-9d0f-6aa27f033016 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:33.698076 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a1bbc-4c67-42ff-90b6-49b423f0d779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:33.699158 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a1bbc-4c67-42ff-90b6-49b423f0d779 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:33.699627 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a1bbc-4c67-42ff-90b6-49b423f0d779 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:33.700088 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-703a1bbc-4c67-42ff-90b6-49b423f0d779 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:33.729537 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed560c5-ec44-4ff9-a53f-ec0ee1b0713d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:33.730280 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed560c5-ec44-4ff9-a53f-ec0ee1b0713d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:33.730656 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed560c5-ec44-4ff9-a53f-ec0ee1b0713d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:33.731030 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bed560c5-ec44-4ff9-a53f-ec0ee1b0713d None admin] PATH_INFO: `/v3/users/neutron` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:33.741213 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed560c5-ec44-4ff9-a53f-ec0ee1b0713d None admin] RBAC: Authorizing `identity:get_user(user_id=neutron)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:33.743038 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bed560c5-ec44-4ff9-a53f-ec0ee1b0713d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:33.757544 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-bed560c5-ec44-4ff9-a53f-ec0ee1b0713d None admin] Could not find user: neutron.: keystone.exception.UserNotFound: Could not find user: neutron. Aug 21 00:52:33.757544 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:33.757544 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:33.757544 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:33.757544 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:33.757544 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:33.757544 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:33.757544 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:33.757544 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:33.757544 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:33.757544 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:33.757544 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:33.757544 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:33.757544 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:33.757544 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:33.757544 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:33.760014 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:33.760014 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:33.760014 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:33.760014 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:33.760014 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:33.760014 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:33.760014 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:33.760014 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:33.760014 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:33.760014 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:33.760014 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:33.760014 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:33.760014 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:33.760014 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:33.760014 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:33.760014 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:33.760014 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:33.760014 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:33.763655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:33.763655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:33.763655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:33.763655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:33.763655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:33.763655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:33.763655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:33.763655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:33.763655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: neutron. Aug 21 00:52:33.763655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:33.765784 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 328/656] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:33 2022] GET /identity/v3/users/neutron => generated 85 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:33.765996 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed560c5-ec44-4ff9-a53f-ec0ee1b0713d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:33.781640 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:33.836144 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a1bbc-4c67-42ff-90b6-49b423f0d779 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:33.838886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-703a1bbc-4c67-42ff-90b6-49b423f0d779 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:33.892815 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:33.941827 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bed560c5-ec44-4ff9-a53f-ec0ee1b0713d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:34.003662 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20adc53c-31b8-4982-8115-5dc7ad91e586 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:34.004931 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adc53c-31b8-4982-8115-5dc7ad91e586 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:34.005418 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adc53c-31b8-4982-8115-5dc7ad91e586 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:34.005824 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20adc53c-31b8-4982-8115-5dc7ad91e586 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:34.006756 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20adc53c-31b8-4982-8115-5dc7ad91e586 None admin] RBAC: Adding query filter params (domain_id=default, name=cinder) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:34.007207 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20adc53c-31b8-4982-8115-5dc7ad91e586 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:34.008871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20adc53c-31b8-4982-8115-5dc7ad91e586 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:34.039662 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 329/657] 10.222.0.49 () {56 vars in 1137 bytes} [Sun Aug 21 00:52:33 2022] GET /identity/v3/users?domain_id=default&name=cinder => generated 372 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:34.041069 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20adc53c-31b8-4982-8115-5dc7ad91e586 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:34.042326 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 329/658] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:33 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:52:34.043824 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a1bbc-4c67-42ff-90b6-49b423f0d779 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:34.160963 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:34.211723 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20adc53c-31b8-4982-8115-5dc7ad91e586 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:34.248559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-703a1bbc-4c67-42ff-90b6-49b423f0d779 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:34.284542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea75d1-b627-4152-a471-453100e0ae9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:34.285593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea75d1-b627-4152-a471-453100e0ae9c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:34.286065 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea75d1-b627-4152-a471-453100e0ae9c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:34.286529 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61ea75d1-b627-4152-a471-453100e0ae9c None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:34.287835 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea75d1-b627-4152-a471-453100e0ae9c None admin] RBAC: Adding query filter params (domain_id=default, name=neutron) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:34.288350 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea75d1-b627-4152-a471-453100e0ae9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:34.291121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61ea75d1-b627-4152-a471-453100e0ae9c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:34.293124 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:34.306947 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26362d3-8528-45f8-a2bf-1a5dbfdc9f78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:34.308305 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26362d3-8528-45f8-a2bf-1a5dbfdc9f78 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:34.308678 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26362d3-8528-45f8-a2bf-1a5dbfdc9f78 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:34.308863 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b26362d3-8528-45f8-a2bf-1a5dbfdc9f78 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:34.324860 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 330/659] 10.222.0.49 () {56 vars in 1139 bytes} [Sun Aug 21 00:52:34 2022] GET /identity/v3/users?domain_id=default&name=neutron => generated 374 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:34.326677 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea75d1-b627-4152-a471-453100e0ae9c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:34.419687 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26362d3-8528-45f8-a2bf-1a5dbfdc9f78 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:34.422675 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b26362d3-8528-45f8-a2bf-1a5dbfdc9f78 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:34.511159 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61ea75d1-b627-4152-a471-453100e0ae9c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:34.567098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:34.594799 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-994d9600-6a24-4ce6-8278-8b38edd948b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:34.595761 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d9600-6a24-4ce6-8278-8b38edd948b8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:34.596218 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d9600-6a24-4ce6-8278-8b38edd948b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:34.596664 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-994d9600-6a24-4ce6-8278-8b38edd948b8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:34.616425 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d9600-6a24-4ce6-8278-8b38edd948b8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:34.620667 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-994d9600-6a24-4ce6-8278-8b38edd948b8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:34.642031 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-994d9600-6a24-4ce6-8278-8b38edd948b8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:34.642031 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:34.642031 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:34.642031 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:34.642031 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:34.642031 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:34.642031 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:34.642031 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:34.642031 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:34.642031 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:34.642031 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:34.642031 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:34.642031 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:34.642031 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:34.642031 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:34.642031 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:34.643932 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:34.643932 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:34.643932 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:34.643932 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:34.643932 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:34.643932 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:34.643932 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:34.643932 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:34.643932 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:34.643932 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:34.643932 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:34.643932 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:34.643932 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:34.643932 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:34.643932 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:34.643932 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:34.643932 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:34.646155 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:34.646155 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:34.646155 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:34.649961 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 331/660] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:34.652172 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 330/661] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 609 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:52:34.652843 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f7b3b-09f0-4f13-823d-74ec890b3d07 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:34.653341 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f7b3b-09f0-4f13-823d-74ec890b3d07 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:34.653733 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26362d3-8528-45f8-a2bf-1a5dbfdc9f78 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:34.653901 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-045f7b3b-09f0-4f13-823d-74ec890b3d07 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:34.655921 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 332/662] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:34 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:34.660699 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f7b3b-09f0-4f13-823d-74ec890b3d07 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:34.711736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:34.834771 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b26362d3-8528-45f8-a2bf-1a5dbfdc9f78 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:34.854248 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-045f7b3b-09f0-4f13-823d-74ec890b3d07 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:34.900735 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c75ea-1b63-4c16-b6e1-e7632cf8d435 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:34.901976 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c75ea-1b63-4c16-b6e1-e7632cf8d435 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:34.902536 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c75ea-1b63-4c16-b6e1-e7632cf8d435 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:34.903114 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee1c75ea-1b63-4c16-b6e1-e7632cf8d435 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:34.919460 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada0c68-91a5-40c8-b462-deec87a6080b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:34.920488 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada0c68-91a5-40c8-b462-deec87a6080b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:34.920937 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada0c68-91a5-40c8-b462-deec87a6080b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:34.921491 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eada0c68-91a5-40c8-b462-deec87a6080b None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:34.922637 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada0c68-91a5-40c8-b462-deec87a6080b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:34.923147 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada0c68-91a5-40c8-b462-deec87a6080b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:34.925689 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eada0c68-91a5-40c8-b462-deec87a6080b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:34.955512 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 333/663] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:34 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:34.955512 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada0c68-91a5-40c8-b462-deec87a6080b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:35.011427 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:35.042211 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c75ea-1b63-4c16-b6e1-e7632cf8d435 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:35.044149 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ee1c75ea-1b63-4c16-b6e1-e7632cf8d435 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:35.085342 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:35.122517 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eada0c68-91a5-40c8-b462-deec87a6080b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:35.171095 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ceee013b-583d-4973-90f7-e2f3743829bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:35.172076 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee013b-583d-4973-90f7-e2f3743829bd None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:35.172516 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee013b-583d-4973-90f7-e2f3743829bd None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:35.172953 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ceee013b-583d-4973-90f7-e2f3743829bd None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:35.186891 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee013b-583d-4973-90f7-e2f3743829bd None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:35.188875 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ceee013b-583d-4973-90f7-e2f3743829bd None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:35.208985 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ceee013b-583d-4973-90f7-e2f3743829bd None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:35.208985 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:35.208985 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:35.208985 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:35.208985 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:35.208985 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:35.208985 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:35.208985 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:35.208985 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:35.208985 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:35.208985 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:35.208985 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:35.208985 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:35.208985 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:35.208985 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:35.208985 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:35.210832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:35.210832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:35.210832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:35.210832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:35.210832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:35.210832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:35.210832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:35.210832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:35.210832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:35.210832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:35.210832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:35.210832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:35.210832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:35.210832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:35.210832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:35.210832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:35.210832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:35.212784 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:35.212784 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:35.212784 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:35.220112 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 334/664] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:34 2022] GET /identity/v3/domains/Default => generated 87 bytes in 270 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:35.222368 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0bf57-c77a-40e1-a039-bcfc5017a8d8 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:35.222817 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0bf57-c77a-40e1-a039-bcfc5017a8d8 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:35.223246 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be0bf57-c77a-40e1-a039-bcfc5017a8d8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:35.245108 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 331/665] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:34 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 587 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:52:35.245108 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c75ea-1b63-4c16-b6e1-e7632cf8d435 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:35.254026 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-1be0bf57-c77a-40e1-a039-bcfc5017a8d8 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:35.255561 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1be0bf57-c77a-40e1-a039-bcfc5017a8d8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:35.384007 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 335/666] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:35 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:35.385369 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0bf57-c77a-40e1-a039-bcfc5017a8d8 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:35.425125 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:35.437291 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ee1c75ea-1b63-4c16-b6e1-e7632cf8d435 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:35.491018 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:35.508804 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15739d-d096-4f7e-bfbe-0ee33fd61645 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:35.510279 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15739d-d096-4f7e-bfbe-0ee33fd61645 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:35.511044 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15739d-d096-4f7e-bfbe-0ee33fd61645 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:35.511689 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b15739d-d096-4f7e-bfbe-0ee33fd61645 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:35.523959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15739d-d096-4f7e-bfbe-0ee33fd61645 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:35.526579 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b15739d-d096-4f7e-bfbe-0ee33fd61645 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:35.544496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-6b15739d-d096-4f7e-bfbe-0ee33fd61645 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:35.544496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:35.544496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:35.544496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:35.544496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:35.544496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:35.544496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:35.544496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:35.544496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:35.544496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:35.544496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:35.544496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:35.544496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:35.544496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:35.544496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:35.545712 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:35.545712 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:35.545712 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:35.545712 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:35.545712 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:35.545712 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:35.545712 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:35.545712 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:35.545712 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:35.545712 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:35.545712 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:35.545712 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:35.545712 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:35.545712 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:35.545712 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:35.545712 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:35.545712 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:35.547037 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:35.547037 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:35.547037 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:35.547037 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:35.547037 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:35.547037 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:35.547037 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:35.547037 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:35.549783 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 332/667] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:35.551005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15739d-d096-4f7e-bfbe-0ee33fd61645 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:35.596675 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1be0bf57-c77a-40e1-a039-bcfc5017a8d8 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:35.670172 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448cf60-e48d-4c4d-9e95-315465322526 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:35.671392 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448cf60-e48d-4c4d-9e95-315465322526 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:35.672045 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448cf60-e48d-4c4d-9e95-315465322526 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:35.672655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2448cf60-e48d-4c4d-9e95-315465322526 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:35.674357 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448cf60-e48d-4c4d-9e95-315465322526 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:35.675083 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448cf60-e48d-4c4d-9e95-315465322526 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:35.677775 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2448cf60-e48d-4c4d-9e95-315465322526 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:35.705878 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 336/668] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 321 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:35.707447 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448cf60-e48d-4c4d-9e95-315465322526 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:35.763115 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b15739d-d096-4f7e-bfbe-0ee33fd61645 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:35.839062 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3d017-e983-483e-863c-1ac1df8d4ec5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:35.840657 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3d017-e983-483e-863c-1ac1df8d4ec5 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:35.841418 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3d017-e983-483e-863c-1ac1df8d4ec5 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:35.842105 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ea3d017-e983-483e-863c-1ac1df8d4ec5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:35.867140 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3d017-e983-483e-863c-1ac1df8d4ec5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:35.870900 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ea3d017-e983-483e-863c-1ac1df8d4ec5 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:35.901457 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:35.906522 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-3ea3d017-e983-483e-863c-1ac1df8d4ec5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:35.906522 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:35.906522 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:35.906522 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:35.906522 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:35.906522 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:35.906522 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:35.906522 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:35.906522 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:35.906522 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:35.906522 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:35.906522 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:35.906522 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:35.906522 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:35.906522 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:35.906522 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:35.909844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:35.909844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:35.909844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:35.909844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:35.909844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:35.909844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:35.909844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:35.909844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:35.909844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:35.909844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:35.909844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:35.909844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:35.909844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:35.909844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:35.909844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:35.909844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:35.909844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:35.912227 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:35.912227 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:35.912227 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:35.912227 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 333/669] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:35.912227 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3d017-e983-483e-863c-1ac1df8d4ec5 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:35.953089 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2448cf60-e48d-4c4d-9e95-315465322526 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:35.996341 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:36.025201 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce26b87-b34d-414b-94a4-795ad9d8dbc1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:36.026268 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce26b87-b34d-414b-94a4-795ad9d8dbc1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:36.026829 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce26b87-b34d-414b-94a4-795ad9d8dbc1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:36.027300 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ce26b87-b34d-414b-94a4-795ad9d8dbc1 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:36.029448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce26b87-b34d-414b-94a4-795ad9d8dbc1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:36.029989 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce26b87-b34d-414b-94a4-795ad9d8dbc1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:36.032745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2ce26b87-b34d-414b-94a4-795ad9d8dbc1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:36.065104 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 337/670] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:36.065104 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce26b87-b34d-414b-94a4-795ad9d8dbc1 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:36.137390 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ea3d017-e983-483e-863c-1ac1df8d4ec5 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:36.214320 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96768f0-ce8b-463d-91be-36105a65c649 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:36.215940 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96768f0-ce8b-463d-91be-36105a65c649 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:36.216769 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96768f0-ce8b-463d-91be-36105a65c649 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:36.217564 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f96768f0-ce8b-463d-91be-36105a65c649 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:36.233728 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96768f0-ce8b-463d-91be-36105a65c649 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:36.237251 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f96768f0-ce8b-463d-91be-36105a65c649 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:36.259873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-f96768f0-ce8b-463d-91be-36105a65c649 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:36.259873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:36.259873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:36.259873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:36.259873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:36.259873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:36.259873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:36.259873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:36.259873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:36.259873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:36.259873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:36.259873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:36.259873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:36.259873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:36.259873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:36.261688 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:36.261688 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:36.261688 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:36.261688 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:36.261688 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:36.261688 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:36.261688 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:36.261688 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:36.261688 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:36.261688 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:36.261688 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:36.261688 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:36.261688 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:36.261688 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:36.261688 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:36.261688 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:36.261688 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:36.263482 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:36.263482 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:36.263482 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:36.263482 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:36.263482 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:36.263482 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:36.263482 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:36.263482 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:36.263482 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 334/671] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:36.263482 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96768f0-ce8b-463d-91be-36105a65c649 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:36.282412 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ce26b87-b34d-414b-94a4-795ad9d8dbc1 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:36.348710 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd1371-03c0-44be-a19b-7f4305dbf092 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:36.349822 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd1371-03c0-44be-a19b-7f4305dbf092 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:36.350300 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd1371-03c0-44be-a19b-7f4305dbf092 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:36.350780 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16cd1371-03c0-44be-a19b-7f4305dbf092 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:36.364197 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:36.374744 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16cd1371-03c0-44be-a19b-7f4305dbf092 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:36.385160 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-16cd1371-03c0-44be-a19b-7f4305dbf092 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:36.385160 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:36.385160 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:36.385160 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:36.385160 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:36.385160 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:36.385160 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:36.385160 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:36.385160 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:36.385160 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:36.385160 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:36.385160 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:36.385160 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:36.385160 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:36.385160 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:36.385160 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:36.387350 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:36.387350 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:36.387350 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:36.387350 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:36.387350 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:36.387350 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:36.387350 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:36.387350 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:36.387350 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:36.387350 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:36.387350 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:36.387350 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:36.387350 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:36.387350 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:36.387350 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:36.387350 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:36.389294 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:36.389294 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:36.389294 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:36.389294 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:36.389294 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:36.389294 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:36.389294 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:36.389294 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:36.389294 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:36.389294 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:36.389294 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:36.389294 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:36.393543 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 338/672] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:36 2022] GET /identity/v3/roles/service => generated 85 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:36.395159 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd1371-03c0-44be-a19b-7f4305dbf092 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:36.445540 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:36.453829 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f96768f0-ce8b-463d-91be-36105a65c649 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:36.520227 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7530f-08bd-4075-925a-919296957420 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:36.521228 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7530f-08bd-4075-925a-919296957420 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:36.521721 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7530f-08bd-4075-925a-919296957420 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:36.522319 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7f7530f-08bd-4075-925a-919296957420 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:36.523475 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7530f-08bd-4075-925a-919296957420 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:36.523994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7530f-08bd-4075-925a-919296957420 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:36.526745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7f7530f-08bd-4075-925a-919296957420 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:36.537310 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16cd1371-03c0-44be-a19b-7f4305dbf092 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:36.549895 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 335/673] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:36 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:36.551797 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7530f-08bd-4075-925a-919296957420 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:36.595314 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6ac701c0-28f6-4f70-94f7-8cdd70421e29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:36.596164 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac701c0-28f6-4f70-94f7-8cdd70421e29 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:36.596705 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac701c0-28f6-4f70-94f7-8cdd70421e29 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:36.597103 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ac701c0-28f6-4f70-94f7-8cdd70421e29 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:36.598053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac701c0-28f6-4f70-94f7-8cdd70421e29 None admin] RBAC: Adding query filter params (role.id=b549ba322af24099825f8949d2060adf, scope.project.id=838e996d09a0454b9bcdc5aef03ef203, user.id=77362a2134af4ede855882c58f40c472) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:36.598511 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac701c0-28f6-4f70-94f7-8cdd70421e29 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:36.600301 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6ac701c0-28f6-4f70-94f7-8cdd70421e29 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:36.607897 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 339/674] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:36 2022] GET /identity/v3/role_assignments?user.id=77362a2134af4ede855882c58f40c472&scope.project.id=838e996d09a0454b9bcdc5aef03ef203&role.id=b549ba322af24099825f8949d2060adf => generated 608 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:36.609993 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa2e3f-0969-480b-91e3-7a968d0737b8 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:36.610530 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa2e3f-0969-480b-91e3-7a968d0737b8 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:36.610951 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cfaa2e3f-0969-480b-91e3-7a968d0737b8 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:36.617469 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 340/675] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:36.617469 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa2e3f-0969-480b-91e3-7a968d0737b8 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:36.715425 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:36.745445 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7f7530f-08bd-4075-925a-919296957420 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:36.791545 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8042f-aa2f-4fd3-b4c3-cb2ca1d31efc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:36.792455 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8042f-aa2f-4fd3-b4c3-cb2ca1d31efc None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:36.792827 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8042f-aa2f-4fd3-b4c3-cb2ca1d31efc None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:36.793232 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9aa8042f-aa2f-4fd3-b4c3-cb2ca1d31efc None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:36.794269 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8042f-aa2f-4fd3-b4c3-cb2ca1d31efc None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:36.794689 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8042f-aa2f-4fd3-b4c3-cb2ca1d31efc None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:36.796499 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9aa8042f-aa2f-4fd3-b4c3-cb2ca1d31efc None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:36.807821 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cfaa2e3f-0969-480b-91e3-7a968d0737b8 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:36.819365 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 336/676] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 262 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:36.819365 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8042f-aa2f-4fd3-b4c3-cb2ca1d31efc None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:36.849475 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:36.882670 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97587050-fc69-47a2-ba73-1ea0eac844b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:36.884308 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97587050-fc69-47a2-ba73-1ea0eac844b6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:36.884308 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97587050-fc69-47a2-ba73-1ea0eac844b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:36.884308 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97587050-fc69-47a2-ba73-1ea0eac844b6 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:36.885406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97587050-fc69-47a2-ba73-1ea0eac844b6 None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:36.885959 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97587050-fc69-47a2-ba73-1ea0eac844b6 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:36.888155 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97587050-fc69-47a2-ba73-1ea0eac844b6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:36.903731 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 341/677] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:36 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:36.906396 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c4e83-8114-4ba0-a1f0-1fecadb41327 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:36.906928 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c4e83-8114-4ba0-a1f0-1fecadb41327 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:36.907357 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de3c4e83-8114-4ba0-a1f0-1fecadb41327 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:36.933632 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-de3c4e83-8114-4ba0-a1f0-1fecadb41327 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:36.935196 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-de3c4e83-8114-4ba0-a1f0-1fecadb41327 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:37.007421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9aa8042f-aa2f-4fd3-b4c3-cb2ca1d31efc None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:37.067135 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e2b0c-e25e-47a2-a51e-b914e31ff83e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:37.068172 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e2b0c-e25e-47a2-a51e-b914e31ff83e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:37.068790 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e2b0c-e25e-47a2-a51e-b914e31ff83e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:37.068946 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 342/678] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:36 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:37.069600 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-070e2b0c-e25e-47a2-a51e-b914e31ff83e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:37.070412 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c4e83-8114-4ba0-a1f0-1fecadb41327 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:37.091107 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e2b0c-e25e-47a2-a51e-b914e31ff83e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:37.094399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-070e2b0c-e25e-47a2-a51e-b914e31ff83e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:37.117924 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-070e2b0c-e25e-47a2-a51e-b914e31ff83e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:37.117924 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:37.117924 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:37.117924 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:37.117924 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:37.117924 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:37.117924 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:37.117924 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:37.117924 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:37.117924 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:37.117924 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:37.117924 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:37.117924 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:37.117924 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:37.117924 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:37.119865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:37.119865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:37.119865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:37.119865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:37.119865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:37.119865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:37.119865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:37.119865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:37.119865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:37.119865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:37.119865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:37.119865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:37.119865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:37.119865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:37.119865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:37.119865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:37.119865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:37.121836 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:37.121836 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:37.121836 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:37.121836 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:37.121836 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:37.121836 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:37.121836 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:37.121836 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:37.125728 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 337/679] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:36 2022] GET /identity/v3/projects/service => generated 88 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:37.127661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e2b0c-e25e-47a2-a51e-b914e31ff83e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:37.186102 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:37.282570 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de3c4e83-8114-4ba0-a1f0-1fecadb41327 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:37.305338 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:37.377108 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-070e2b0c-e25e-47a2-a51e-b914e31ff83e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:37.377388 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16b245-adac-43a3-9f6c-7b702d146d38 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:37.378129 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16b245-adac-43a3-9f6c-7b702d146d38 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:37.378532 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16b245-adac-43a3-9f6c-7b702d146d38 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:37.378922 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf16b245-adac-43a3-9f6c-7b702d146d38 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:37.380070 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16b245-adac-43a3-9f6c-7b702d146d38 None admin] RBAC: Adding query filter params (role.id=b549ba322af24099825f8949d2060adf, scope.project.id=838e996d09a0454b9bcdc5aef03ef203, user.id=67305d6f08d64f8ba39abe10bd4974c9) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:37.380529 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16b245-adac-43a3-9f6c-7b702d146d38 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:37.383278 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf16b245-adac-43a3-9f6c-7b702d146d38 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:37.401193 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 343/680] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:37 2022] GET /identity/v3/role_assignments?user.id=67305d6f08d64f8ba39abe10bd4974c9&scope.project.id=838e996d09a0454b9bcdc5aef03ef203&role.id=b549ba322af24099825f8949d2060adf => generated 608 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:37.403402 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16b245-adac-43a3-9f6c-7b702d146d38 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:37.500710 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb118469-8b55-48f4-8f09-4e9ef1d5ab12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:37.501916 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb118469-8b55-48f4-8f09-4e9ef1d5ab12 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:37.502425 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb118469-8b55-48f4-8f09-4e9ef1d5ab12 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:37.503154 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb118469-8b55-48f4-8f09-4e9ef1d5ab12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:37.546659 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb118469-8b55-48f4-8f09-4e9ef1d5ab12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:37.549663 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bb118469-8b55-48f4-8f09-4e9ef1d5ab12 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:37.600265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-bb118469-8b55-48f4-8f09-4e9ef1d5ab12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:37.600265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:37.600265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:37.600265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:37.600265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:37.600265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:37.600265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:37.600265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:37.600265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:37.600265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:37.600265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:37.600265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:37.600265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:37.600265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:37.600265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:37.600265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:37.602084 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:37.602084 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:37.602084 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:37.602084 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:37.602084 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:37.602084 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:37.602084 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:37.602084 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:37.602084 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:37.602084 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:37.602084 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:37.602084 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:37.602084 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:37.602084 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:37.602084 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:37.602084 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:37.602084 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:37.603791 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:37.603791 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:37.603791 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:37.609203 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 338/681] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:37 2022] GET /identity/v3/domains/Default => generated 87 bytes in 481 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:37.610999 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb118469-8b55-48f4-8f09-4e9ef1d5ab12 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:37.707266 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf16b245-adac-43a3-9f6c-7b702d146d38 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:37.745378 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:37.777207 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ac8de-a59f-45c3-afa1-7b30a6f2ac87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:37.777884 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ac8de-a59f-45c3-afa1-7b30a6f2ac87 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:37.778320 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ac8de-a59f-45c3-afa1-7b30a6f2ac87 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:37.778743 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c4ac8de-a59f-45c3-afa1-7b30a6f2ac87 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:37.779468 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ac8de-a59f-45c3-afa1-7b30a6f2ac87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:37.779841 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ac8de-a59f-45c3-afa1-7b30a6f2ac87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:37.781435 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c4ac8de-a59f-45c3-afa1-7b30a6f2ac87 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:37.799944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 344/682] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:37 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 398 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:37.801362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ac8de-a59f-45c3-afa1-7b30a6f2ac87 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:37.819419 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb118469-8b55-48f4-8f09-4e9ef1d5ab12 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:37.876501 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:37.888187 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a6923-c44e-4a0c-b09d-fa989caf5991 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:37.889467 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a6923-c44e-4a0c-b09d-fa989caf5991 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:37.890050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a6923-c44e-4a0c-b09d-fa989caf5991 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:37.890702 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-482a6923-c44e-4a0c-b09d-fa989caf5991 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:37.915686 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-482a6923-c44e-4a0c-b09d-fa989caf5991 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:37.925601 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-482a6923-c44e-4a0c-b09d-fa989caf5991 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:52:37.925601 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:37.925601 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:37.925601 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:37.925601 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:37.925601 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:37.925601 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:37.925601 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:37.925601 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:37.925601 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:37.925601 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:37.925601 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:37.925601 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:37.925601 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:37.925601 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:37.925601 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:37.927449 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:37.927449 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:37.927449 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:37.927449 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:37.927449 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:37.927449 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:37.927449 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:37.927449 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:37.927449 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:37.927449 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:37.927449 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:37.927449 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:37.927449 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:37.927449 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:37.927449 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:37.927449 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:37.929027 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:37.929027 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:37.929027 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:37.929027 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:37.929027 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:37.929027 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:37.929027 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:37.929027 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:37.929027 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:37.929027 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:37.929027 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:52:37.929027 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:37.936318 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 339/683] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:52:37 2022] GET /identity/v3/roles/admin => generated 83 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:37.938259 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a6923-c44e-4a0c-b09d-fa989caf5991 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:37.978485 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c4ac8de-a59f-45c3-afa1-7b30a6f2ac87 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:38.051567 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019adbf5-4209-4a45-a0b9-a548ec676f93 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:38.052581 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019adbf5-4209-4a45-a0b9-a548ec676f93 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:38.053012 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019adbf5-4209-4a45-a0b9-a548ec676f93 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:38.053496 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-019adbf5-4209-4a45-a0b9-a548ec676f93 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:38.054715 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019adbf5-4209-4a45-a0b9-a548ec676f93 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:38.055126 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019adbf5-4209-4a45-a0b9-a548ec676f93 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:38.057969 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-019adbf5-4209-4a45-a0b9-a548ec676f93 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:38.087943 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 345/684] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:37 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:38.089959 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019adbf5-4209-4a45-a0b9-a548ec676f93 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:38.139735 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-482a6923-c44e-4a0c-b09d-fa989caf5991 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:38.149355 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:38.203764 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcc07c-08ef-4299-90d9-04c872004ffd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:38.205114 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcc07c-08ef-4299-90d9-04c872004ffd None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:38.205745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcc07c-08ef-4299-90d9-04c872004ffd None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:38.206396 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ebcc07c-08ef-4299-90d9-04c872004ffd None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:38.207864 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcc07c-08ef-4299-90d9-04c872004ffd None admin] RBAC: Adding query filter params (role.id=b549ba322af24099825f8949d2060adf, scope.project.id=838e996d09a0454b9bcdc5aef03ef203, user.id=78c29816db2d4193b293a0f94b4d1a01) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:38.208586 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcc07c-08ef-4299-90d9-04c872004ffd None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:38.211660 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9ebcc07c-08ef-4299-90d9-04c872004ffd None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:38.224362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-019adbf5-4209-4a45-a0b9-a548ec676f93 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:38.228990 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 340/685] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:37 2022] GET /identity/v3/role_assignments?user.id=78c29816db2d4193b293a0f94b4d1a01&scope.project.id=838e996d09a0454b9bcdc5aef03ef203&role.id=b549ba322af24099825f8949d2060adf => generated 608 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:38.230932 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcc07c-08ef-4299-90d9-04c872004ffd None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:38.268650 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82571193-8a7b-4720-9174-891124b43912 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:38.269337 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82571193-8a7b-4720-9174-891124b43912 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:38.269805 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82571193-8a7b-4720-9174-891124b43912 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:38.270102 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82571193-8a7b-4720-9174-891124b43912 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:38.270804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82571193-8a7b-4720-9174-891124b43912 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:38.271180 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82571193-8a7b-4720-9174-891124b43912 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:38.272670 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82571193-8a7b-4720-9174-891124b43912 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:38.288158 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 346/686] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:52:38 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 195 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:38.291646 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82571193-8a7b-4720-9174-891124b43912 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:38.348564 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:38.439003 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9ebcc07c-08ef-4299-90d9-04c872004ffd None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:38.492509 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:38.497345 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82571193-8a7b-4720-9174-891124b43912 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:38.511798 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9bc5c-6623-43c7-bcb5-9523f11531a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:38.513785 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9bc5c-6623-43c7-bcb5-9523f11531a1 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:38.514470 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9bc5c-6623-43c7-bcb5-9523f11531a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:38.515164 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0c9bc5c-6623-43c7-bcb5-9523f11531a1 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:38.534981 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9bc5c-6623-43c7-bcb5-9523f11531a1 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:38.538599 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0c9bc5c-6623-43c7-bcb5-9523f11531a1 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:38.540114 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a371b10-0556-4fa4-9870-789db5d060e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:38.540778 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a371b10-0556-4fa4-9870-789db5d060e7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:38.541087 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a371b10-0556-4fa4-9870-789db5d060e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:38.541418 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a371b10-0556-4fa4-9870-789db5d060e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:38.555277 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a371b10-0556-4fa4-9870-789db5d060e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:38.556889 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5a371b10-0556-4fa4-9870-789db5d060e7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:38.562825 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-d0c9bc5c-6623-43c7-bcb5-9523f11531a1 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:52:38.562825 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:38.562825 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:38.562825 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:38.562825 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:38.562825 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:38.562825 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:38.562825 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:38.562825 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:38.562825 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:38.562825 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:38.562825 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:38.562825 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:38.562825 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:38.562825 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:38.562825 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:38.564579 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:38.564579 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:38.564579 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:38.564579 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:38.564579 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:38.564579 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:38.564579 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:38.564579 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:38.564579 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:38.564579 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:38.564579 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:38.564579 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:38.564579 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:38.564579 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:38.564579 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:38.564579 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:38.564579 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:38.564579 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:38.566322 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:38.566322 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:38.566322 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:38.566322 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:38.566322 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:38.566322 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:38.566322 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:38.566322 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:38.566322 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:52:38.566322 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:38.570485 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 341/687] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:52:38 2022] GET /identity/v3/users/swift => generated 83 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:38.579936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-5a371b10-0556-4fa4-9870-789db5d060e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:38.579936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:38.579936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:38.579936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:38.579936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:38.579936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:38.579936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:38.579936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:38.579936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:38.579936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:38.579936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:38.579936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:38.579936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:38.579936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:38.579936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:38.579936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:38.581666 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:38.581666 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:38.581666 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:38.581666 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:38.581666 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:38.581666 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:38.581666 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:38.581666 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:38.581666 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:38.581666 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:38.581666 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:38.581666 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:38.581666 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:38.581666 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:38.581666 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:38.581666 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:38.581666 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:38.583210 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:38.583210 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:38.583210 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:38.587245 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 347/688] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:38 2022] GET /identity/v3/domains/Default => generated 87 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:38.589139 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9bc5c-6623-43c7-bcb5-9523f11531a1 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:38.590463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a371b10-0556-4fa4-9870-789db5d060e7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:38.808309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0c9bc5c-6623-43c7-bcb5-9523f11531a1 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:38.830303 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5a371b10-0556-4fa4-9870-789db5d060e7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:38.869634 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:38.894333 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef6204-2272-4a1e-9b15-ae52f286fb9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:38.895384 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef6204-2272-4a1e-9b15-ae52f286fb9c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:38.896209 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef6204-2272-4a1e-9b15-ae52f286fb9c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:38.896673 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bef6204-2272-4a1e-9b15-ae52f286fb9c None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:38.898088 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef6204-2272-4a1e-9b15-ae52f286fb9c None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:38.898618 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef6204-2272-4a1e-9b15-ae52f286fb9c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:38.901342 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6bef6204-2272-4a1e-9b15-ae52f286fb9c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:38.923434 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e7f61-3a41-4991-99d7-9044429e8193 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:38.924449 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e7f61-3a41-4991-99d7-9044429e8193 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:38.924911 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e7f61-3a41-4991-99d7-9044429e8193 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:38.925378 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a0e7f61-3a41-4991-99d7-9044429e8193 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:38.926407 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e7f61-3a41-4991-99d7-9044429e8193 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:38.926873 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e7f61-3a41-4991-99d7-9044429e8193 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:38.929246 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a0e7f61-3a41-4991-99d7-9044429e8193 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:38.952596 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 348/689] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:38 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:38.958056 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 342/690] 10.222.0.49 () {56 vars in 1135 bytes} [Sun Aug 21 00:52:38 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 370 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:38.969722 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e7f61-3a41-4991-99d7-9044429e8193 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:38.969991 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef6204-2272-4a1e-9b15-ae52f286fb9c None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:38.996867 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:39.197699 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a0e7f61-3a41-4991-99d7-9044429e8193 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:39.220667 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bef6204-2272-4a1e-9b15-ae52f286fb9c None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:39.265485 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d628ed-c10b-498b-9636-f0c5956682dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:39.267029 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d628ed-c10b-498b-9636-f0c5956682dd None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:39.267705 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d628ed-c10b-498b-9636-f0c5956682dd None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:39.268449 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44d628ed-c10b-498b-9636-f0c5956682dd None admin] PATH_INFO: `/v3/users/nova` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:39.287321 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d628ed-c10b-498b-9636-f0c5956682dd None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:39.290195 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44d628ed-c10b-498b-9636-f0c5956682dd None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:39.312658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-44d628ed-c10b-498b-9636-f0c5956682dd None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:52:39.312658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:39.312658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:39.312658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:39.312658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:39.312658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:39.312658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:39.312658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:39.312658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:39.312658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:39.312658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:39.312658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:39.312658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:39.312658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:39.312658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:39.312658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:39.314289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:39.314289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:39.314289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:39.314289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:39.314289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:39.314289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:39.314289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:39.314289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:39.314289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:39.314289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:39.314289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:39.314289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:39.314289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:39.314289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:39.314289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:39.314289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:39.314289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:39.314289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:39.315947 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:39.315947 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:39.315947 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:39.315947 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:39.315947 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:39.315947 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:39.315947 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:39.315947 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:39.315947 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:52:39.315947 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:39.320447 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 349/691] 10.222.0.49 () {56 vars in 1093 bytes} [Sun Aug 21 00:52:38 2022] GET /identity/v3/users/nova => generated 82 bytes in 352 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:39.329637 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d628ed-c10b-498b-9636-f0c5956682dd None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:39.353819 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf2f45-8466-472a-b53d-cd725a30f2ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:39.354754 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf2f45-8466-472a-b53d-cd725a30f2ee None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:39.355185 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf2f45-8466-472a-b53d-cd725a30f2ee None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:39.355604 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-adbf2f45-8466-472a-b53d-cd725a30f2ee None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:39.473768 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:39.529536 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:39.548928 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf2f45-8466-472a-b53d-cd725a30f2ee None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:39.551797 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-adbf2f45-8466-472a-b53d-cd725a30f2ee None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:39.621343 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44d628ed-c10b-498b-9636-f0c5956682dd None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:39.685213 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bac535-ab82-43ff-b7b2-e67af14b30b3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:39.686678 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bac535-ab82-43ff-b7b2-e67af14b30b3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:39.687403 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bac535-ab82-43ff-b7b2-e67af14b30b3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:39.688134 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69bac535-ab82-43ff-b7b2-e67af14b30b3 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:39.689558 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bac535-ab82-43ff-b7b2-e67af14b30b3 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:39.690319 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bac535-ab82-43ff-b7b2-e67af14b30b3 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:39.692958 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69bac535-ab82-43ff-b7b2-e67af14b30b3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:39.727601 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 350/692] 10.222.0.49 () {56 vars in 1133 bytes} [Sun Aug 21 00:52:39 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:39.745363 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bac535-ab82-43ff-b7b2-e67af14b30b3 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:39.871404 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 343/693] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:38 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 902 msecs (HTTP/1.1 200) 6 headers in 358 bytes (2 switches on core 0) Aug 21 00:52:39.881458 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf2f45-8466-472a-b53d-cd725a30f2ee None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:39.948649 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69bac535-ab82-43ff-b7b2-e67af14b30b3 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:40.011518 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:40.025263 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8710032f-7791-4b1b-92f2-9cde88c02cf2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:40.026976 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710032f-7791-4b1b-92f2-9cde88c02cf2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:40.027756 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710032f-7791-4b1b-92f2-9cde88c02cf2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:40.028558 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8710032f-7791-4b1b-92f2-9cde88c02cf2 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:40.033739 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:40.066571 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-adbf2f45-8466-472a-b53d-cd725a30f2ee None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:40.141984 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58fb7d-843a-4386-82e7-a9416ead7c42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:40.142695 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58fb7d-843a-4386-82e7-a9416ead7c42 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:40.142975 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58fb7d-843a-4386-82e7-a9416ead7c42 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:40.143250 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d58fb7d-843a-4386-82e7-a9416ead7c42 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:40.162522 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58fb7d-843a-4386-82e7-a9416ead7c42 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:40.164134 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d58fb7d-843a-4386-82e7-a9416ead7c42 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:40.217393 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-4d58fb7d-843a-4386-82e7-a9416ead7c42 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:40.217393 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:40.217393 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:40.217393 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:40.217393 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:40.217393 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:40.217393 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:40.217393 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:40.217393 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:40.217393 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:40.217393 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:40.217393 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:40.217393 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:40.217393 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:40.217393 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:40.217393 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:40.219127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:40.219127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:40.219127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:40.219127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:40.219127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:40.219127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:40.219127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:40.219127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:40.219127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:40.219127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:40.219127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:40.219127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:40.219127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:40.219127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:40.219127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:40.219127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:40.219127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:40.220712 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:40.220712 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:40.220712 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:40.220712 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 344/694] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:39 2022] GET /identity/v3/domains/Default => generated 87 bytes in 339 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:40.237082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8710032f-7791-4b1b-92f2-9cde88c02cf2 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:40.237082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8710032f-7791-4b1b-92f2-9cde88c02cf2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:40.237478 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58fb7d-843a-4386-82e7-a9416ead7c42 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:40.457554 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 351/695] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:39 2022] GET /identity/v3/auth/tokens => generated 799 bytes in 713 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:52:40.460125 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00007a5-8a60-4229-90a5-5db927159067 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:40.460639 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00007a5-8a60-4229-90a5-5db927159067 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:40.465092 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e00007a5-8a60-4229-90a5-5db927159067 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:40.468239 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 352/696] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:40 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:40.469875 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00007a5-8a60-4229-90a5-5db927159067 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:40.496780 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d58fb7d-843a-4386-82e7-a9416ead7c42 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:40.548589 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:40.549560 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:40.574209 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58071edb-cef9-4850-8186-c3635418dca4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:40.575782 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58071edb-cef9-4850-8186-c3635418dca4 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:40.576580 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58071edb-cef9-4850-8186-c3635418dca4 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:40.577385 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58071edb-cef9-4850-8186-c3635418dca4 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:40.578902 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58071edb-cef9-4850-8186-c3635418dca4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:40.579815 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58071edb-cef9-4850-8186-c3635418dca4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:40.582695 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58071edb-cef9-4850-8186-c3635418dca4 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:40.615160 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 345/697] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 387 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:40.617832 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23141278-365f-4485-9820-60d67ef265ba None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:40.618641 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23141278-365f-4485-9820-60d67ef265ba None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:40.619383 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23141278-365f-4485-9820-60d67ef265ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:40.675981 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-23141278-365f-4485-9820-60d67ef265ba None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:40.678617 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-23141278-365f-4485-9820-60d67ef265ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:40.759934 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e00007a5-8a60-4229-90a5-5db927159067 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:40.844091 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 346/698] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:40 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:40.846160 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23141278-365f-4485-9820-60d67ef265ba None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:40.863894 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76917b1b-e550-4e71-a265-9bef0f4d61c6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:40.865020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76917b1b-e550-4e71-a265-9bef0f4d61c6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:40.865520 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76917b1b-e550-4e71-a265-9bef0f4d61c6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:40.866003 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76917b1b-e550-4e71-a265-9bef0f4d61c6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:40.910703 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76917b1b-e550-4e71-a265-9bef0f4d61c6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:40.914351 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76917b1b-e550-4e71-a265-9bef0f4d61c6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:40.967459 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-76917b1b-e550-4e71-a265-9bef0f4d61c6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:40.967459 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:40.967459 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:40.967459 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:40.967459 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:40.967459 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:40.967459 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:40.967459 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:40.967459 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:40.967459 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:40.967459 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:40.967459 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:40.967459 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:40.967459 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:40.967459 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:40.967459 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:40.969312 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:40.969312 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:40.969312 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:40.969312 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:40.969312 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:40.969312 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:40.969312 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:40.969312 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:40.969312 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:40.969312 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:40.969312 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:40.969312 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:40.969312 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:40.969312 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:40.969312 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:40.969312 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:40.969312 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:40.971006 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:40.971006 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:40.971006 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:40.971006 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 353/699] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 501 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:40.986668 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76917b1b-e550-4e71-a265-9bef0f4d61c6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:41.171371 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23141278-365f-4485-9820-60d67ef265ba None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:41.207569 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:41.207891 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:41.248886 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76917b1b-e550-4e71-a265-9bef0f4d61c6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:41.285177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41b2c6c1-132d-4be0-9bd5-97cae8274373 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:41.286787 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2c6c1-132d-4be0-9bd5-97cae8274373 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:41.287564 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2c6c1-132d-4be0-9bd5-97cae8274373 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:41.288358 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41b2c6c1-132d-4be0-9bd5-97cae8274373 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:41.319831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cf0d036-4733-43da-a450-1be3f14ae76d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:41.320851 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0d036-4733-43da-a450-1be3f14ae76d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:41.321979 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0d036-4733-43da-a450-1be3f14ae76d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:41.322458 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cf0d036-4733-43da-a450-1be3f14ae76d None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:41.323667 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0d036-4733-43da-a450-1be3f14ae76d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:41.324081 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2c6c1-132d-4be0-9bd5-97cae8274373 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:41.324277 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0d036-4733-43da-a450-1be3f14ae76d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:41.327541 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41b2c6c1-132d-4be0-9bd5-97cae8274373 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:41.331022 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cf0d036-4733-43da-a450-1be3f14ae76d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:41.354618 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-41b2c6c1-132d-4be0-9bd5-97cae8274373 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:41.354618 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:41.354618 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:41.354618 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:41.354618 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:41.354618 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:41.354618 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:41.354618 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:41.354618 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:41.354618 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:41.354618 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:41.354618 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:41.354618 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:41.354618 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:41.354618 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:41.356477 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:41.356477 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:41.356477 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:41.356477 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:41.356477 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:41.356477 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:41.356477 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:41.356477 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:41.356477 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:41.356477 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:41.356477 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:41.356477 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:41.356477 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:41.356477 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:41.356477 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:41.356477 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:41.356477 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:41.358376 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:41.358376 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:41.358376 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:41.358376 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:41.358376 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:41.358376 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:41.358376 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:41.358376 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:41.363592 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 347/700] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:40 2022] GET /identity/v3/projects/service => generated 88 bytes in 518 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:41.366357 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87957bd-cef8-4ed1-9ec7-87067adec318 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:41.367374 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87957bd-cef8-4ed1-9ec7-87067adec318 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:41.368281 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f87957bd-cef8-4ed1-9ec7-87067adec318 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:41.372216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 348/701] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:41 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:41.374176 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87957bd-cef8-4ed1-9ec7-87067adec318 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:41.377192 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 354/702] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:41.382820 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23e206-8d4a-4e05-83c7-b67a57de1cba None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:41.383334 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23e206-8d4a-4e05-83c7-b67a57de1cba None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:41.383798 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d23e206-8d4a-4e05-83c7-b67a57de1cba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:41.437329 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-6d23e206-8d4a-4e05-83c7-b67a57de1cba None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:41.439225 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6d23e206-8d4a-4e05-83c7-b67a57de1cba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:41.571797 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 355/703] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:41 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:41.573395 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23e206-8d4a-4e05-83c7-b67a57de1cba None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:41.607783 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f87957bd-cef8-4ed1-9ec7-87067adec318 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:41.676450 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b96e9-3a4d-4a2f-9fc8-be6c8fc33370 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:41.677519 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b96e9-3a4d-4a2f-9fc8-be6c8fc33370 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:41.677967 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b96e9-3a4d-4a2f-9fc8-be6c8fc33370 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:41.678422 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e1b96e9-3a4d-4a2f-9fc8-be6c8fc33370 None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:41.679690 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b96e9-3a4d-4a2f-9fc8-be6c8fc33370 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:41.680284 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b96e9-3a4d-4a2f-9fc8-be6c8fc33370 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:41.683354 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e1b96e9-3a4d-4a2f-9fc8-be6c8fc33370 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:41.707463 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 349/704] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 334 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:41.709070 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b96e9-3a4d-4a2f-9fc8-be6c8fc33370 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:41.730295 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:41.777091 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:41.790474 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d23e206-8d4a-4e05-83c7-b67a57de1cba None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:41.839379 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77af7f-bdbb-4c00-9fc2-6e72f664e8fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:41.840036 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77af7f-bdbb-4c00-9fc2-6e72f664e8fc None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:41.840313 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77af7f-bdbb-4c00-9fc2-6e72f664e8fc None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:41.840651 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff77af7f-bdbb-4c00-9fc2-6e72f664e8fc None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:41.849291 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77af7f-bdbb-4c00-9fc2-6e72f664e8fc None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:41.850811 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff77af7f-bdbb-4c00-9fc2-6e72f664e8fc None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:41.864140 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ff77af7f-bdbb-4c00-9fc2-6e72f664e8fc None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:41.864140 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:41.864140 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:41.864140 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:41.864140 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:41.864140 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:41.864140 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:41.864140 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:41.864140 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:41.864140 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:41.864140 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:41.864140 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:41.864140 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:41.864140 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:41.864140 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:41.866017 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:41.866017 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:41.866017 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:41.866017 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:41.866017 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:41.866017 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:41.866017 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:41.866017 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:41.866017 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:41.866017 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:41.866017 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:41.866017 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:41.866017 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:41.866017 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:41.866017 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:41.866017 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:41.866017 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:41.867959 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:41.867959 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:41.867959 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:41.867959 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:41.867959 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:41.867959 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:41.867959 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:41.867959 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:41.867959 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 356/705] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:41.869638 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77af7f-bdbb-4c00-9fc2-6e72f664e8fc None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:41.925653 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e1b96e9-3a4d-4a2f-9fc8-be6c8fc33370 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:42.003074 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14f52b-3838-4cc8-8389-1ec6c9e72e82 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:42.004256 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14f52b-3838-4cc8-8389-1ec6c9e72e82 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:42.004870 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14f52b-3838-4cc8-8389-1ec6c9e72e82 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:42.005464 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e14f52b-3838-4cc8-8389-1ec6c9e72e82 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:42.026105 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14f52b-3838-4cc8-8389-1ec6c9e72e82 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:42.029363 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0e14f52b-3838-4cc8-8389-1ec6c9e72e82 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:42.060032 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-0e14f52b-3838-4cc8-8389-1ec6c9e72e82 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:42.060032 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:42.060032 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:42.060032 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:42.060032 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:42.060032 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:42.060032 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:42.060032 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:42.060032 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:42.060032 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:42.060032 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:42.060032 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:42.060032 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:42.060032 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:42.060032 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:42.060032 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:42.062113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:42.062113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:42.062113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:42.062113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:42.062113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:42.062113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:42.062113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:42.062113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:42.062113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:42.062113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:42.062113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:42.062113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:42.062113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:42.062113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:42.062113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:42.062113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:42.062113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:42.063864 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:42.063864 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:42.063864 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:42.063864 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 350/706] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:41 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:42.063864 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14f52b-3838-4cc8-8389-1ec6c9e72e82 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:42.069649 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff77af7f-bdbb-4c00-9fc2-6e72f664e8fc None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:42.124883 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:42.132562 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2766a-e77d-48ce-a355-fa6339ee93bc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:42.134365 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2766a-e77d-48ce-a355-fa6339ee93bc None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:42.134839 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2766a-e77d-48ce-a355-fa6339ee93bc None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:42.135325 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b0e2766a-e77d-48ce-a355-fa6339ee93bc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:42.136713 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2766a-e77d-48ce-a355-fa6339ee93bc None admin] RBAC: Adding query filter params (role.id=b549ba322af24099825f8949d2060adf, scope.project.id=838e996d09a0454b9bcdc5aef03ef203, user.id=f66a877fdca340f48f54b48e5367a194) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:42.137292 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2766a-e77d-48ce-a355-fa6339ee93bc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:42.139939 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b0e2766a-e77d-48ce-a355-fa6339ee93bc None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:42.151505 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 357/707] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:41 2022] GET /identity/v3/role_assignments?user.id=f66a877fdca340f48f54b48e5367a194&scope.project.id=838e996d09a0454b9bcdc5aef03ef203&role.id=b549ba322af24099825f8949d2060adf => generated 608 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:42.152683 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2766a-e77d-48ce-a355-fa6339ee93bc None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:42.248840 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:42.281885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0e14f52b-3838-4cc8-8389-1ec6c9e72e82 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:42.353423 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316db35-4393-499b-8e1f-0ceb1b1dd514 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:42.354639 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316db35-4393-499b-8e1f-0ceb1b1dd514 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:42.355135 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316db35-4393-499b-8e1f-0ceb1b1dd514 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:42.355621 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f316db35-4393-499b-8e1f-0ceb1b1dd514 None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:42.356568 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b0e2766a-e77d-48ce-a355-fa6339ee93bc None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:42.357241 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316db35-4393-499b-8e1f-0ceb1b1dd514 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:42.357568 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316db35-4393-499b-8e1f-0ceb1b1dd514 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:42.360735 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f316db35-4393-499b-8e1f-0ceb1b1dd514 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:42.391121 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 351/708] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:42 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 328 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:42.392820 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316db35-4393-499b-8e1f-0ceb1b1dd514 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:42.435878 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d4630-efb3-4e35-83aa-7b78c0b010d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:42.436960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d4630-efb3-4e35-83aa-7b78c0b010d6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:42.437486 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d4630-efb3-4e35-83aa-7b78c0b010d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:42.437960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a94d4630-efb3-4e35-83aa-7b78c0b010d6 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:42.439074 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d4630-efb3-4e35-83aa-7b78c0b010d6 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:42.442553 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a94d4630-efb3-4e35-83aa-7b78c0b010d6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:42.465168 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-a94d4630-efb3-4e35-83aa-7b78c0b010d6 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 00:52:42.465168 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:42.465168 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:52:42.465168 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:52:42.465168 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:52:42.465168 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:52:42.465168 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:52:42.465168 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:42.465168 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 00:52:42.465168 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:42.465168 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:42.465168 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:42.465168 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:42.465168 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:42.465168 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:42.465168 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:42.465168 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:42.467161 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:42.467161 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:42.467161 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:42.467161 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:42.467161 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:42.467161 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:42.467161 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:52:42.467161 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:52:42.467161 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:52:42.467161 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:52:42.467161 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:42.467161 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:42.467161 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:42.467161 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:42.467161 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:42.467161 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:42.469379 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:42.469379 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:42.469379 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:42.469379 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:42.469379 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:42.469379 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:42.469379 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:42.469379 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:42.469379 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:42.469379 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:42.469379 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:52:42.469379 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:42.469379 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 00:52:42.469379 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:42.469379 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 358/709] 10.222.0.49 () {56 vars in 1129 bytes} [Sun Aug 21 00:52:42 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:42.471058 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d4630-efb3-4e35-83aa-7b78c0b010d6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:42.583828 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:42.598462 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f316db35-4393-499b-8e1f-0ceb1b1dd514 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:42.664716 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d67897c-b935-4174-86cb-e484a7a857c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:42.665755 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67897c-b935-4174-86cb-e484a7a857c9 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:42.666257 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67897c-b935-4174-86cb-e484a7a857c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:42.666647 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a94d4630-efb3-4e35-83aa-7b78c0b010d6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:42.666802 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d67897c-b935-4174-86cb-e484a7a857c9 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:42.667931 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67897c-b935-4174-86cb-e484a7a857c9 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:42.668446 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67897c-b935-4174-86cb-e484a7a857c9 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:42.670960 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d67897c-b935-4174-86cb-e484a7a857c9 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:42.700444 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 352/710] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:42 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:42.700444 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237120b-ad77-4870-bcc6-5ae9bba1fbcb None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:42.700444 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237120b-ad77-4870-bcc6-5ae9bba1fbcb None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:42.700444 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e237120b-ad77-4870-bcc6-5ae9bba1fbcb None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:42.700444 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 353/711] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:42 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:42.701227 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237120b-ad77-4870-bcc6-5ae9bba1fbcb None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:42.718680 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:42.749376 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473d815-7df8-42c2-8c9f-f3d0490e7577 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:42.750746 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473d815-7df8-42c2-8c9f-f3d0490e7577 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:42.751208 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473d815-7df8-42c2-8c9f-f3d0490e7577 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:42.751696 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1473d815-7df8-42c2-8c9f-f3d0490e7577 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:42.753138 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473d815-7df8-42c2-8c9f-f3d0490e7577 None admin] RBAC: Adding query filter params (role.id=c73e9539582145ed8eedc48648b9d738, scope.project.id=838e996d09a0454b9bcdc5aef03ef203, user.id=6b003ae4a082485ab608bf84c1657159) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:42.753696 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473d815-7df8-42c2-8c9f-f3d0490e7577 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:42.756495 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1473d815-7df8-42c2-8c9f-f3d0490e7577 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:42.775279 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 359/712] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:42 2022] GET /identity/v3/role_assignments?user.id=6b003ae4a082485ab608bf84c1657159&scope.project.id=838e996d09a0454b9bcdc5aef03ef203&role.id=c73e9539582145ed8eedc48648b9d738 => generated 259 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:42.775279 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473d815-7df8-42c2-8c9f-f3d0490e7577 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:42.931245 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e237120b-ad77-4870-bcc6-5ae9bba1fbcb None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:42.990307 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1473d815-7df8-42c2-8c9f-f3d0490e7577 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:43.003826 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ceb05d4-82df-4517-94ac-9a03eea9269e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:43.005036 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb05d4-82df-4517-94ac-9a03eea9269e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:43.005716 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb05d4-82df-4517-94ac-9a03eea9269e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:43.006301 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ceb05d4-82df-4517-94ac-9a03eea9269e None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:43.007664 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb05d4-82df-4517-94ac-9a03eea9269e None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:43.008926 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb05d4-82df-4517-94ac-9a03eea9269e None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:43.011274 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ceb05d4-82df-4517-94ac-9a03eea9269e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:43.026061 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 354/713] 10.222.0.49 () {56 vars in 1124 bytes} [Sun Aug 21 00:52:42 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:43.028499 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9f9a1-7ba3-406a-93ee-f987c58e50d9 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:43.029269 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9f9a1-7ba3-406a-93ee-f987c58e50d9 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:43.029699 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bec9f9a1-7ba3-406a-93ee-f987c58e50d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:43.049593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:43.069207 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-bec9f9a1-7ba3-406a-93ee-f987c58e50d9 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:43.071419 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-bec9f9a1-7ba3-406a-93ee-f987c58e50d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:43.073862 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e42691-ad05-4a86-be9a-c3b3f0a19270 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:43.075381 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e42691-ad05-4a86-be9a-c3b3f0a19270 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:43.076191 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e42691-ad05-4a86-be9a-c3b3f0a19270 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:43.076859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30e42691-ad05-4a86-be9a-c3b3f0a19270 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:43.078403 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e42691-ad05-4a86-be9a-c3b3f0a19270 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:43.081548 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-30e42691-ad05-4a86-be9a-c3b3f0a19270 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:43.133456 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 360/714] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 21 00:52:42 2022] POST /identity/v3/users => generated 254 bytes in 356 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:52:43.133456 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e42691-ad05-4a86-be9a-c3b3f0a19270 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:43.249141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:43.263495 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 355/715] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:43 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 236 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:43.434139 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30e42691-ad05-4a86-be9a-c3b3f0a19270 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:43.525683 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb31c1-5ebc-46a6-b7fe-d4b562f7a6ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:43.527427 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb31c1-5ebc-46a6-b7fe-d4b562f7a6ef None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:43.528204 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb31c1-5ebc-46a6-b7fe-d4b562f7a6ef None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:43.528938 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97cb31c1-5ebc-46a6-b7fe-d4b562f7a6ef None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:43.530427 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb31c1-5ebc-46a6-b7fe-d4b562f7a6ef None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:43.531293 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb31c1-5ebc-46a6-b7fe-d4b562f7a6ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:43.534189 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97cb31c1-5ebc-46a6-b7fe-d4b562f7a6ef None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:43.549677 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 361/716] 10.222.0.49 () {56 vars in 1124 bytes} [Sun Aug 21 00:52:43 2022] GET /identity/v3/services?type=block-storage => generated 130 bytes in 420 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:43.819492 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9f9a1-7ba3-406a-93ee-f987c58e50d9 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:44.027628 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bec9f9a1-7ba3-406a-93ee-f987c58e50d9 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:44.107216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f483d5-9f3a-47ea-9163-3354edd2c398 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:44.107799 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f483d5-9f3a-47ea-9163-3354edd2c398 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:44.108075 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f483d5-9f3a-47ea-9163-3354edd2c398 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:44.108355 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61f483d5-9f3a-47ea-9163-3354edd2c398 None admin] PATH_INFO: `/v3/services/network` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:44.108998 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f483d5-9f3a-47ea-9163-3354edd2c398 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:44.110452 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61f483d5-9f3a-47ea-9163-3354edd2c398 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:44.143679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-61f483d5-9f3a-47ea-9163-3354edd2c398 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 00:52:44.143679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:44.143679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:52:44.143679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:52:44.143679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:52:44.143679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:52:44.143679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:52:44.143679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:44.143679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 00:52:44.143679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:44.143679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:44.143679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:44.143679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:44.143679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:44.143679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:44.143679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:44.143679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:44.145137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:44.145137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:44.145137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:44.145137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:44.145137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:44.145137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:44.145137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:52:44.145137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:52:44.145137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:52:44.145137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:52:44.145137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:44.145137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:44.145137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:44.145137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:44.145137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:44.145137 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:44.146015 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:44.146015 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:44.146015 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:44.146015 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:44.146015 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:44.146015 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:44.146015 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:44.146015 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:44.146015 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:44.146015 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:44.146015 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:52:44.146015 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:44.146015 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 00:52:44.146015 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:44.146975 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 356/717] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:43 2022] GET /identity/v3/services/network => generated 88 bytes in 327 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:44.156781 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb31c1-5ebc-46a6-b7fe-d4b562f7a6ef None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:44.264636 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:44.384636 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97cb31c1-5ebc-46a6-b7fe-d4b562f7a6ef None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:44.455257 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d4b9434-7511-40d4-8512-d9e41396f906 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:44.457514 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b9434-7511-40d4-8512-d9e41396f906 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:44.458265 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b9434-7511-40d4-8512-d9e41396f906 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:44.458982 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d4b9434-7511-40d4-8512-d9e41396f906 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:44.460412 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4b9434-7511-40d4-8512-d9e41396f906 None admin] RBAC: Adding query filter params (name=network) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:44.461288 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4b9434-7511-40d4-8512-d9e41396f906 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:44.463984 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d4b9434-7511-40d4-8512-d9e41396f906 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:44.472776 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 362/718] 10.222.0.49 () {56 vars in 1112 bytes} [Sun Aug 21 00:52:44 2022] GET /identity/v3/services?name=network => generated 124 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:44.481146 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f483d5-9f3a-47ea-9163-3354edd2c398 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:44.636725 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:44.725769 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61f483d5-9f3a-47ea-9163-3354edd2c398 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:44.802310 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf33115b-0583-4e8f-bf41-705f7712206b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:44.803331 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33115b-0583-4e8f-bf41-705f7712206b None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:44.803795 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33115b-0583-4e8f-bf41-705f7712206b None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:44.804332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf33115b-0583-4e8f-bf41-705f7712206b None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:44.805410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33115b-0583-4e8f-bf41-705f7712206b None admin] RBAC: Adding query filter params (type=network) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:44.805857 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33115b-0583-4e8f-bf41-705f7712206b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:44.808124 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf33115b-0583-4e8f-bf41-705f7712206b None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:44.822494 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 357/719] 10.222.0.49 () {56 vars in 1112 bytes} [Sun Aug 21 00:52:44 2022] GET /identity/v3/services?type=network => generated 124 bytes in 344 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:45.990583 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d2b0a-427b-444a-bb1d-7ad0c9b9c02e None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:45.991447 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d2b0a-427b-444a-bb1d-7ad0c9b9c02e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:45.991597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c2d2b0a-427b-444a-bb1d-7ad0c9b9c02e None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:45.994614 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 363/720] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:45 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:46.003971 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36181c-f582-41c9-8da8-c70db731fdd3 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:46.004770 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36181c-f582-41c9-8da8-c70db731fdd3 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:46.004968 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb36181c-f582-41c9-8da8-c70db731fdd3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:46.041190 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-eb36181c-f582-41c9-8da8-c70db731fdd3 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:46.043434 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-eb36181c-f582-41c9-8da8-c70db731fdd3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:46.224929 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 358/721] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 223 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:52:46.532977 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e564b0c-bc89-448b-b322-b96f6e8d3d71 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:46.533546 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e564b0c-bc89-448b-b322-b96f6e8d3d71 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:46.533924 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e564b0c-bc89-448b-b322-b96f6e8d3d71 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:46.537184 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 364/722] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:46 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:46.546820 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bb6cf-19ea-44b5-bfb7-66c9aa43d897 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:46.547358 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bb6cf-19ea-44b5-bfb7-66c9aa43d897 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:46.548064 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e9bb6cf-19ea-44b5-bfb7-66c9aa43d897 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:46.584490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-1e9bb6cf-19ea-44b5-bfb7-66c9aa43d897 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:46.586641 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-1e9bb6cf-19ea-44b5-bfb7-66c9aa43d897 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:46.733700 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:46.762986 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 359/723] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:46 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:46.917838 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e564b0c-bc89-448b-b322-b96f6e8d3d71 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:47.175557 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e564b0c-bc89-448b-b322-b96f6e8d3d71 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:47.199017 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:47.261318 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6033c-0138-4757-a07b-acad30fd7c4f None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:47.262952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6033c-0138-4757-a07b-acad30fd7c4f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:47.263682 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52b6033c-0138-4757-a07b-acad30fd7c4f None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:47.273306 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 360/724] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:47 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:52:47.276792 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d811683-87b0-42bd-82c4-0aa5b48cef67 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:47.277802 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d811683-87b0-42bd-82c4-0aa5b48cef67 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:47.278570 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d811683-87b0-42bd-82c4-0aa5b48cef67 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:47.297092 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9bf3a59e-52ed-45fb-8b59-f1eaf20eff97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:47.297092 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3a59e-52ed-45fb-8b59-f1eaf20eff97 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:47.297092 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3a59e-52ed-45fb-8b59-f1eaf20eff97 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:47.297092 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9bf3a59e-52ed-45fb-8b59-f1eaf20eff97 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:47.316282 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-7d811683-87b0-42bd-82c4-0aa5b48cef67 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:47.318800 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7d811683-87b0-42bd-82c4-0aa5b48cef67 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:47.335668 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9bf3a59e-52ed-45fb-8b59-f1eaf20eff97 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:47.344417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-9bf3a59e-52ed-45fb-8b59-f1eaf20eff97 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:52:47.344417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:47.344417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:47.344417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:47.344417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:47.344417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:47.344417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:47.344417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:47.344417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:47.344417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:47.344417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:47.344417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:47.344417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:47.344417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:47.344417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:47.344417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:47.346273 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:47.346273 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:47.346273 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:47.346273 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:47.346273 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:47.346273 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:47.346273 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:47.346273 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:47.346273 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:47.346273 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:47.346273 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:47.346273 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:47.346273 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:47.346273 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:47.346273 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:47.346273 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:47.348382 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:47.348382 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:47.348382 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:47.348382 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:47.348382 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:47.348382 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:47.348382 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:47.348382 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:47.348382 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:47.348382 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:47.348382 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:52:47.348382 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:47.348382 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 365/725] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:52:46 2022] GET /identity/v3/roles/admin => generated 83 bytes in 430 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:52:47.355120 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e69150-69bc-4985-b523-3e4224877679 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:47.355614 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e69150-69bc-4985-b523-3e4224877679 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:47.356221 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69e69150-69bc-4985-b523-3e4224877679 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:47.359116 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 366/726] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:47 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:47.364869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e69150-69bc-4985-b523-3e4224877679 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:47.460223 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 361/727] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 185 msecs (HTTP/1.1 201) 6 headers in 363 bytes (2 switches on core 0) Aug 21 00:52:47.462728 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ebab1-99c9-4ab7-8799-45257844711f None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:47.463223 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ebab1-99c9-4ab7-8799-45257844711f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:47.463635 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-590ebab1-99c9-4ab7-8799-45257844711f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:47.498351 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-590ebab1-99c9-4ab7-8799-45257844711f None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:47.500582 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-590ebab1-99c9-4ab7-8799-45257844711f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:47.611117 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69e69150-69bc-4985-b523-3e4224877679 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:47.645244 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 362/728] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:47 2022] POST /identity/v3/auth/tokens => generated 799 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:47.647058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ebab1-99c9-4ab7-8799-45257844711f None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:47.713178 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d4a07-e088-45f6-b0e7-558eecf053ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:47.715700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d4a07-e088-45f6-b0e7-558eecf053ea None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:47.716173 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d4a07-e088-45f6-b0e7-558eecf053ea None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:47.716661 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-326d4a07-e088-45f6-b0e7-558eecf053ea None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:47.718372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d4a07-e088-45f6-b0e7-558eecf053ea None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:47.718908 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d4a07-e088-45f6-b0e7-558eecf053ea None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:47.727779 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-326d4a07-e088-45f6-b0e7-558eecf053ea None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:47.764380 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 367/729] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:52:47 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 399 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:47.774560 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d4a07-e088-45f6-b0e7-558eecf053ea None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:47.825836 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:47.877031 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:47.970937 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-590ebab1-99c9-4ab7-8799-45257844711f None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:48.038967 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7a3f1-3a9f-4a2f-9424-a8b63852f3fb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:48.040056 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7a3f1-3a9f-4a2f-9424-a8b63852f3fb None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:48.040542 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7a3f1-3a9f-4a2f-9424-a8b63852f3fb None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:48.041015 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bdc7a3f1-3a9f-4a2f-9424-a8b63852f3fb None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:48.059755 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-326d4a07-e088-45f6-b0e7-558eecf053ea None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:48.061539 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bdc7a3f1-3a9f-4a2f-9424-a8b63852f3fb None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:48.070886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-bdc7a3f1-3a9f-4a2f-9424-a8b63852f3fb None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:52:48.070886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:48.070886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:48.070886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:48.070886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:48.070886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:48.070886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:48.070886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:48.070886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:48.070886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:48.070886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:48.070886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:48.070886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:48.070886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:48.070886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:48.070886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:48.072745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:48.072745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:48.072745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:48.072745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:48.072745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:48.072745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:48.072745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:48.072745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:48.072745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:48.072745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:48.072745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:48.072745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:48.072745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:48.072745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:48.072745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:48.072745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:48.074983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:48.074983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:48.074983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:48.074983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:48.074983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:48.074983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:48.074983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:48.074983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:48.074983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:48.074983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:48.074983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:52:48.074983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:48.074983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 363/730] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:52:47 2022] GET /identity/v3/roles/admin => generated 83 bytes in 427 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:48.074983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7a3f1-3a9f-4a2f-9424-a8b63852f3fb None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:48.125983 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04a9b4-cde9-41fe-a930-0012187d14a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:48.127032 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04a9b4-cde9-41fe-a930-0012187d14a1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:48.127492 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04a9b4-cde9-41fe-a930-0012187d14a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:48.127986 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed04a9b4-cde9-41fe-a930-0012187d14a1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:48.147554 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04a9b4-cde9-41fe-a930-0012187d14a1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:48.150236 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed04a9b4-cde9-41fe-a930-0012187d14a1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:48.178214 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ed04a9b4-cde9-41fe-a930-0012187d14a1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:48.178214 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:48.178214 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:48.178214 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:48.178214 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:48.178214 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:48.178214 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:48.178214 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:48.178214 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:48.178214 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:48.178214 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:48.178214 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:48.178214 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:48.178214 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:48.178214 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:48.178214 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:48.183100 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:48.183100 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:48.183100 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:48.183100 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:48.183100 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:48.183100 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:48.183100 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:48.183100 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:48.183100 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:48.183100 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:48.183100 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:48.183100 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:48.183100 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:48.183100 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:48.183100 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:48.183100 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:48.183100 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:48.190002 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:48.190002 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:48.190002 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:48.190002 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 368/731] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 408 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:48.190002 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04a9b4-cde9-41fe-a930-0012187d14a1 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:48.285696 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bdc7a3f1-3a9f-4a2f-9424-a8b63852f3fb None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:48.304804 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:48.337563 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:48.354669 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2defc0-8220-47ca-887c-623688925a95 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:48.355733 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2defc0-8220-47ca-887c-623688925a95 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:48.356212 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2defc0-8220-47ca-887c-623688925a95 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:48.356692 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f2defc0-8220-47ca-887c-623688925a95 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:48.372704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed04a9b4-cde9-41fe-a930-0012187d14a1 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:48.376605 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f2defc0-8220-47ca-887c-623688925a95 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:48.385953 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-5f2defc0-8220-47ca-887c-623688925a95 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:48.385953 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:48.385953 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:48.385953 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:48.385953 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:48.385953 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:48.385953 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:48.385953 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:48.385953 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:48.385953 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:48.385953 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:48.385953 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:48.385953 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:48.385953 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:48.385953 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:48.385953 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:48.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:48.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:48.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:48.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:48.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:48.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:48.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:48.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:48.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:48.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:48.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:48.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:48.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:48.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:48.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:48.387865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:48.391009 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:48.391009 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:48.391009 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:48.391009 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:48.391009 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:48.391009 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:48.391009 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:48.391009 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:48.391009 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:48.391009 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:48.391009 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:52:48.391009 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:48.391009 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 364/732] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:48 2022] GET /identity/v3/roles/service => generated 85 bytes in 314 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:48.391009 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2defc0-8220-47ca-887c-623688925a95 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:48.448820 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eddb27-a1db-4931-959f-7be00e78a954 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:48.450063 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eddb27-a1db-4931-959f-7be00e78a954 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:48.450607 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eddb27-a1db-4931-959f-7be00e78a954 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:48.451105 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08eddb27-a1db-4931-959f-7be00e78a954 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:48.452502 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eddb27-a1db-4931-959f-7be00e78a954 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:48.453102 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eddb27-a1db-4931-959f-7be00e78a954 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:48.455962 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08eddb27-a1db-4931-959f-7be00e78a954 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:48.480345 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 369/733] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:52:48 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 291 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:48.480345 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eddb27-a1db-4931-959f-7be00e78a954 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:48.574948 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f2defc0-8220-47ca-887c-623688925a95 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:48.625150 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e5a91-0a3a-4ae2-aa0b-bcea2094e432 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:48.626473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e5a91-0a3a-4ae2-aa0b-bcea2094e432 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:48.626963 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e5a91-0a3a-4ae2-aa0b-bcea2094e432 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:48.627453 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff8e5a91-0a3a-4ae2-aa0b-bcea2094e432 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:48.628639 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e5a91-0a3a-4ae2-aa0b-bcea2094e432 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:48.629202 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e5a91-0a3a-4ae2-aa0b-bcea2094e432 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:48.631782 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff8e5a91-0a3a-4ae2-aa0b-bcea2094e432 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:48.645146 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08eddb27-a1db-4931-959f-7be00e78a954 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:48.653963 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 365/734] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:48 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 265 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:48.655611 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e5a91-0a3a-4ae2-aa0b-bcea2094e432 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:48.700139 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95061f-e878-40e8-a379-c4dad33ee637 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:48.701229 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95061f-e878-40e8-a379-c4dad33ee637 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:48.701724 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95061f-e878-40e8-a379-c4dad33ee637 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:48.702212 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ac95061f-e878-40e8-a379-c4dad33ee637 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:48.703421 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95061f-e878-40e8-a379-c4dad33ee637 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:48.704576 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:48.706071 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ac95061f-e878-40e8-a379-c4dad33ee637 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:48.733262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 370/735] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 21 00:52:48 2022] POST /identity/v3/services => generated 251 bytes in 259 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:52:48.734593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95061f-e878-40e8-a379-c4dad33ee637 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:48.742104 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:48.830118 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff8e5a91-0a3a-4ae2-aa0b-bcea2094e432 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:48.884400 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-459567d9-1628-465a-b1cc-9c078158f5d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:48.885094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459567d9-1628-465a-b1cc-9c078158f5d8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:48.885399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459567d9-1628-465a-b1cc-9c078158f5d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:48.885688 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-459567d9-1628-465a-b1cc-9c078158f5d8 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:48.886437 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459567d9-1628-465a-b1cc-9c078158f5d8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:48.886842 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459567d9-1628-465a-b1cc-9c078158f5d8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:48.888318 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-459567d9-1628-465a-b1cc-9c078158f5d8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:48.898991 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 366/736] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 21 00:52:48 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 244 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:48.901172 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54beaf93-f9e6-4c84-8e34-b4b266b0cf16 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:48.901728 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54beaf93-f9e6-4c84-8e34-b4b266b0cf16 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:48.902195 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54beaf93-f9e6-4c84-8e34-b4b266b0cf16 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:48.904957 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 367/737] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:48 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:48.906147 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54beaf93-f9e6-4c84-8e34-b4b266b0cf16 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:48.955203 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ac95061f-e878-40e8-a379-c4dad33ee637 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:49.015710 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254ab05-41ff-4edf-b881-406c5af1e2a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:49.016557 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254ab05-41ff-4edf-b881-406c5af1e2a5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:49.016977 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254ab05-41ff-4edf-b881-406c5af1e2a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:49.017482 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b254ab05-41ff-4edf-b881-406c5af1e2a5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:49.036463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254ab05-41ff-4edf-b881-406c5af1e2a5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:49.038444 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b254ab05-41ff-4edf-b881-406c5af1e2a5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:49.057404 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-b254ab05-41ff-4edf-b881-406c5af1e2a5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:49.057404 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:49.057404 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:49.057404 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:49.057404 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:49.057404 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:49.057404 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:49.057404 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:49.057404 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:49.057404 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:49.057404 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:49.057404 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:49.057404 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:49.057404 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:49.057404 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:49.057404 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:49.059797 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:49.059797 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:49.059797 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:49.059797 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:49.059797 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:49.059797 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:49.059797 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:49.059797 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:49.059797 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:49.059797 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:49.059797 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:49.059797 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:49.059797 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:49.059797 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:49.059797 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:49.059797 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:49.059797 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:49.061823 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:49.061823 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:49.061823 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:49.061823 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 371/738] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:48 2022] GET /identity/v3/domains/Default => generated 87 bytes in 325 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:49.061823 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254ab05-41ff-4edf-b881-406c5af1e2a5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:49.072960 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:49.098307 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-54beaf93-f9e6-4c84-8e34-b4b266b0cf16 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:49.144853 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-acc3cb96-6ec5-4439-ae21-d320e4c53399 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:49.145718 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3cb96-6ec5-4439-ae21-d320e4c53399 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:49.146127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3cb96-6ec5-4439-ae21-d320e4c53399 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:49.146529 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-acc3cb96-6ec5-4439-ae21-d320e4c53399 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:49.160805 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3cb96-6ec5-4439-ae21-d320e4c53399 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:49.163688 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-acc3cb96-6ec5-4439-ae21-d320e4c53399 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:49.166227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:49.179750 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-acc3cb96-6ec5-4439-ae21-d320e4c53399 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:52:49.179750 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:49.179750 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:49.179750 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:49.179750 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:49.179750 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:49.179750 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:49.179750 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:49.179750 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:49.179750 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:49.179750 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:49.179750 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:49.179750 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:49.179750 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:49.179750 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:49.179750 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:49.182058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:49.182058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:49.182058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:49.182058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:49.182058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:49.182058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:49.182058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:49.182058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:49.182058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:49.182058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:49.182058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:49.182058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:49.182058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:49.182058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:49.182058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:49.182058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:49.182058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:49.182058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:49.184356 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:49.184356 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:49.184356 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:49.184356 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:49.184356 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:49.184356 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:49.184356 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:49.184356 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:49.184356 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:52:49.184356 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:49.187185 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 368/739] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:52:48 2022] GET /identity/v3/users/swift => generated 83 bytes in 282 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:49.188807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4841bd-81eb-4470-b3ee-14f7f79f0dec None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:49.189157 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4841bd-81eb-4470-b3ee-14f7f79f0dec None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:49.189397 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-de4841bd-81eb-4470-b3ee-14f7f79f0dec None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:49.212302 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-de4841bd-81eb-4470-b3ee-14f7f79f0dec None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:49.217834 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-de4841bd-81eb-4470-b3ee-14f7f79f0dec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:49.264048 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b254ab05-41ff-4edf-b881-406c5af1e2a5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:49.333665 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3524c57-b14b-4a1f-9551-08f393dd6192 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:49.334715 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3524c57-b14b-4a1f-9551-08f393dd6192 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:49.335201 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3524c57-b14b-4a1f-9551-08f393dd6192 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:49.335680 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3524c57-b14b-4a1f-9551-08f393dd6192 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:49.361208 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 369/740] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:49 2022] POST /identity/v3/auth/tokens => generated 903 bytes in 166 msecs (HTTP/1.1 201) 6 headers in 363 bytes (1 switches on core 0) Aug 21 00:52:49.361208 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4841bd-81eb-4470-b3ee-14f7f79f0dec None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:49.369920 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3524c57-b14b-4a1f-9551-08f393dd6192 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:49.382612 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3524c57-b14b-4a1f-9551-08f393dd6192 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:49.411035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-e3524c57-b14b-4a1f-9551-08f393dd6192 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:49.411035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:49.411035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:49.411035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:49.411035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:49.411035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:49.411035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:49.411035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:49.411035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:49.411035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:49.411035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:49.411035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:49.411035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:49.411035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:49.411035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:49.411035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:49.412794 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:49.412794 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:49.412794 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:49.412794 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:49.412794 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:49.412794 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:49.412794 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:49.412794 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:49.412794 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:49.412794 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:49.412794 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:49.412794 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:49.412794 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:49.412794 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:49.412794 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:49.412794 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:49.412794 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:49.415020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:49.415020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:49.415020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:49.415020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 372/741] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:49 2022] GET /identity/v3/domains/Default => generated 87 bytes in 354 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:49.415020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3524c57-b14b-4a1f-9551-08f393dd6192 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:49.526123 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:49.573399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-de4841bd-81eb-4470-b3ee-14f7f79f0dec None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:49.622623 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3524c57-b14b-4a1f-9551-08f393dd6192 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:49.641209 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c70a15-a7fc-4d94-b554-6a465706b517 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:49.642882 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c70a15-a7fc-4d94-b554-6a465706b517 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:49.642882 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c70a15-a7fc-4d94-b554-6a465706b517 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:49.643292 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9c70a15-a7fc-4d94-b554-6a465706b517 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:49.644477 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c70a15-a7fc-4d94-b554-6a465706b517 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:49.645121 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c70a15-a7fc-4d94-b554-6a465706b517 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:49.648063 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9c70a15-a7fc-4d94-b554-6a465706b517 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:49.670708 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 370/742] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 316 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:49.672309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c70a15-a7fc-4d94-b554-6a465706b517 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:49.679025 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:49.702219 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4328e-b2ee-4dc0-9a94-d34f19833b3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:49.703603 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4328e-b2ee-4dc0-9a94-d34f19833b3f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:49.704215 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4328e-b2ee-4dc0-9a94-d34f19833b3f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:49.704820 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d4328e-b2ee-4dc0-9a94-d34f19833b3f None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:49.706611 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d4328e-b2ee-4dc0-9a94-d34f19833b3f None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:49.707310 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d4328e-b2ee-4dc0-9a94-d34f19833b3f None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:49.710563 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d4328e-b2ee-4dc0-9a94-d34f19833b3f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:49.753444 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 373/743] 10.222.0.49 () {56 vars in 1135 bytes} [Sun Aug 21 00:52:49 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 335 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:49.756405 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4328e-b2ee-4dc0-9a94-d34f19833b3f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:49.901553 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9c70a15-a7fc-4d94-b554-6a465706b517 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:49.961003 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d4328e-b2ee-4dc0-9a94-d34f19833b3f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:49.966817 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586d327-bcca-48bc-b305-556e64e23546 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:49.967840 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586d327-bcca-48bc-b305-556e64e23546 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:49.968308 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586d327-bcca-48bc-b305-556e64e23546 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:49.968770 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1586d327-bcca-48bc-b305-556e64e23546 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:49.969978 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586d327-bcca-48bc-b305-556e64e23546 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:49.970509 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586d327-bcca-48bc-b305-556e64e23546 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:49.973196 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1586d327-bcca-48bc-b305-556e64e23546 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:49.978292 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:50.001542 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 371/744] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:49 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 330 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:50.002992 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586d327-bcca-48bc-b305-556e64e23546 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:50.035360 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace05e70-6915-4411-93cf-4ec26454521f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:50.036778 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace05e70-6915-4411-93cf-4ec26454521f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:50.037534 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace05e70-6915-4411-93cf-4ec26454521f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:50.038425 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ace05e70-6915-4411-93cf-4ec26454521f None admin] PATH_INFO: `/v3/users/nova` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:50.054343 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace05e70-6915-4411-93cf-4ec26454521f None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:50.057975 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ace05e70-6915-4411-93cf-4ec26454521f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:50.083121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ace05e70-6915-4411-93cf-4ec26454521f None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:52:50.083121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:50.083121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:50.083121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:50.083121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:50.083121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:50.083121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:50.083121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:50.083121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:50.083121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:50.083121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:50.083121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:50.083121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:50.083121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:50.083121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:50.083121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:50.085020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:50.085020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:50.085020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:50.085020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:50.085020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:50.085020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:50.085020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:50.085020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:50.085020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:50.085020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:50.085020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:50.085020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:50.085020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:50.085020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:50.085020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:50.085020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:50.085020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:50.085020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:50.086946 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:50.086946 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:50.086946 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:50.086946 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:50.086946 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:50.086946 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:50.086946 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:50.086946 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:50.086946 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:52:50.086946 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:50.089329 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 374/745] 10.222.0.49 () {56 vars in 1093 bytes} [Sun Aug 21 00:52:49 2022] GET /identity/v3/users/nova => generated 82 bytes in 335 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:50.090973 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace05e70-6915-4411-93cf-4ec26454521f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:50.149816 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:50.218387 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1586d327-bcca-48bc-b305-556e64e23546 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:50.290107 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415f2ae-e0a6-4d70-afff-57bfa082424b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:50.291164 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415f2ae-e0a6-4d70-afff-57bfa082424b None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:50.291644 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415f2ae-e0a6-4d70-afff-57bfa082424b None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:50.292182 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f415f2ae-e0a6-4d70-afff-57bfa082424b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:50.316932 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ace05e70-6915-4411-93cf-4ec26454521f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:50.387041 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4402a-cce9-46c8-bc87-7f9ac793dbd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:50.388110 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4402a-cce9-46c8-bc87-7f9ac793dbd3 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:50.388594 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4402a-cce9-46c8-bc87-7f9ac793dbd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:50.389125 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4d4402a-cce9-46c8-bc87-7f9ac793dbd3 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:50.390406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4402a-cce9-46c8-bc87-7f9ac793dbd3 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:50.393129 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4d4402a-cce9-46c8-bc87-7f9ac793dbd3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:50.427426 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 375/746] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 21 00:52:50 2022] POST /identity/v3/services => generated 240 bytes in 337 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:52:50.429029 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4402a-cce9-46c8-bc87-7f9ac793dbd3 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:50.439052 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:50.454003 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415f2ae-e0a6-4d70-afff-57bfa082424b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:50.457948 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f415f2ae-e0a6-4d70-afff-57bfa082424b None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:50.631125 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:50.689831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4d4402a-cce9-46c8-bc87-7f9ac793dbd3 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:50.701784 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 372/747] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:50 2022] GET /identity/v3/auth/tokens => generated 903 bytes in 700 msecs (HTTP/1.1 200) 6 headers in 358 bytes (1 switches on core 0) Aug 21 00:52:50.702427 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415f2ae-e0a6-4d70-afff-57bfa082424b None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:50.761017 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34cf78-5e64-4f3d-a814-a2bc90f10a18 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:50.762858 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34cf78-5e64-4f3d-a814-a2bc90f10a18 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:50.763731 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34cf78-5e64-4f3d-a814-a2bc90f10a18 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:50.764487 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e34cf78-5e64-4f3d-a814-a2bc90f10a18 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:50.778584 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34cf78-5e64-4f3d-a814-a2bc90f10a18 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:50.781297 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e34cf78-5e64-4f3d-a814-a2bc90f10a18 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:50.804547 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-8e34cf78-5e64-4f3d-a814-a2bc90f10a18 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:52:50.804547 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:50.804547 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:50.804547 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:50.804547 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:50.804547 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:50.804547 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:50.804547 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:50.804547 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:50.804547 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:50.804547 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:50.804547 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:50.804547 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:50.804547 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:50.804547 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:50.804547 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:50.806112 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:50.806112 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:50.806112 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:50.806112 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:50.806112 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:50.806112 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:50.806112 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:50.806112 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:50.806112 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:50.806112 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:50.806112 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:50.806112 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:50.806112 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:50.806112 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:50.806112 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:50.806112 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:50.806112 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:50.806112 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:50.807664 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:50.807664 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:50.807664 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:50.807664 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:50.807664 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:50.807664 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:50.807664 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:50.807664 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:50.807664 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:52:50.807664 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:50.812215 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 376/748] 10.222.0.49 () {56 vars in 1117 bytes} [Sun Aug 21 00:52:50 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 384 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:50.820185 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34cf78-5e64-4f3d-a814-a2bc90f10a18 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:50.882817 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:50.893713 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f415f2ae-e0a6-4d70-afff-57bfa082424b None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:50.956823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72e239-fc15-440f-b6a4-16da1cf158e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:50.957922 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72e239-fc15-440f-b6a4-16da1cf158e7 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:50.958316 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72e239-fc15-440f-b6a4-16da1cf158e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:50.958785 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be72e239-fc15-440f-b6a4-16da1cf158e7 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:50.960171 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72e239-fc15-440f-b6a4-16da1cf158e7 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:50.960723 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72e239-fc15-440f-b6a4-16da1cf158e7 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:50.963523 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be72e239-fc15-440f-b6a4-16da1cf158e7 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:50.996248 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e34cf78-5e64-4f3d-a814-a2bc90f10a18 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:51.001310 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 373/749] 10.222.0.49 () {56 vars in 1133 bytes} [Sun Aug 21 00:52:50 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:51.002880 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72e239-fc15-440f-b6a4-16da1cf158e7 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:51.079572 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e554f95-975f-435c-a99d-190b3cd2b680 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:51.081654 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e554f95-975f-435c-a99d-190b3cd2b680 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:51.082538 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e554f95-975f-435c-a99d-190b3cd2b680 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:51.083780 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e554f95-975f-435c-a99d-190b3cd2b680 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:51.112810 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e554f95-975f-435c-a99d-190b3cd2b680 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:51.116099 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e554f95-975f-435c-a99d-190b3cd2b680 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:51.121382 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:51.152346 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-9e554f95-975f-435c-a99d-190b3cd2b680 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:51.152346 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:51.152346 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:51.152346 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:51.152346 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:51.152346 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:51.152346 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:51.152346 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:51.152346 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:51.152346 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:51.152346 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:51.152346 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:51.152346 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:51.152346 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:51.152346 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:51.152346 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:51.154281 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:51.154281 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:51.154281 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:51.154281 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:51.154281 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:51.154281 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:51.154281 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:51.154281 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:51.154281 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:51.154281 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:51.154281 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:51.154281 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:51.154281 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:51.154281 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:51.154281 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:51.154281 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:51.154281 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:51.156044 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:51.156044 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:51.156044 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:51.157110 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 377/750] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:50 2022] GET /identity/v3/domains/Default => generated 87 bytes in 344 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:51.160458 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e554f95-975f-435c-a99d-190b3cd2b680 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:51.193539 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be72e239-fc15-440f-b6a4-16da1cf158e7 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:51.272564 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48e2cbc2-34aa-4a2d-94c5-9ad0a40b5ab9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:51.273610 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2cbc2-34aa-4a2d-94c5-9ad0a40b5ab9 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:51.274092 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2cbc2-34aa-4a2d-94c5-9ad0a40b5ab9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:51.274556 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48e2cbc2-34aa-4a2d-94c5-9ad0a40b5ab9 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:51.275871 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2cbc2-34aa-4a2d-94c5-9ad0a40b5ab9 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:51.276437 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2cbc2-34aa-4a2d-94c5-9ad0a40b5ab9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:51.279273 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48e2cbc2-34aa-4a2d-94c5-9ad0a40b5ab9 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:51.316736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 374/751] 10.222.0.49 () {56 vars in 1149 bytes} [Sun Aug 21 00:52:51 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:51.316736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdd9bc-1bfb-428e-9fe9-81083b9bd263 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:51.316736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdd9bc-1bfb-428e-9fe9-81083b9bd263 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:51.316736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36cdd9bc-1bfb-428e-9fe9-81083b9bd263 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:51.317724 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 375/752] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:51.318999 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdd9bc-1bfb-428e-9fe9-81083b9bd263 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:51.349224 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:51.357527 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e554f95-975f-435c-a99d-190b3cd2b680 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:51.419665 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027b0cf-4467-46b3-97c6-53a9187ca012 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:51.420631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027b0cf-4467-46b3-97c6-53a9187ca012 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:51.421088 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027b0cf-4467-46b3-97c6-53a9187ca012 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:51.421570 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d027b0cf-4467-46b3-97c6-53a9187ca012 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:51.441030 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d027b0cf-4467-46b3-97c6-53a9187ca012 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:51.443718 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d027b0cf-4467-46b3-97c6-53a9187ca012 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:51.470113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-d027b0cf-4467-46b3-97c6-53a9187ca012 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:51.470113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:51.470113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:51.470113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:51.470113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:51.470113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:51.470113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:51.470113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:51.470113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:51.470113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:51.470113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:51.470113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:51.470113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:51.470113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:51.470113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:51.470113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:51.471892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:51.471892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:51.471892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:51.471892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:51.471892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:51.471892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:51.471892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:51.471892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:51.471892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:51.471892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:51.471892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:51.471892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:51.471892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:51.471892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:51.471892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:51.471892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:51.471892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:51.473752 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:51.473752 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:51.473752 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:51.473752 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 378/753] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:51 2022] GET /identity/v3/domains/Default => generated 87 bytes in 313 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:51.474199 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027b0cf-4467-46b3-97c6-53a9187ca012 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:51.507757 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36cdd9bc-1bfb-428e-9fe9-81083b9bd263 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:51.559149 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7da9c290-76c7-46d2-b557-a717dee400b6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:51.560179 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9c290-76c7-46d2-b557-a717dee400b6 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:51.560664 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9c290-76c7-46d2-b557-a717dee400b6 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:51.560848 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:51.561202 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7da9c290-76c7-46d2-b557-a717dee400b6 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:51.562891 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9c290-76c7-46d2-b557-a717dee400b6 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:51.562891 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9c290-76c7-46d2-b557-a717dee400b6 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:51.565480 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7da9c290-76c7-46d2-b557-a717dee400b6 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:51.595570 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 376/754] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:51.595570 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54f1e6-2298-41ae-9af7-e96c26a38382 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:51.595570 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54f1e6-2298-41ae-9af7-e96c26a38382 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:51.595570 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3a54f1e6-2298-41ae-9af7-e96c26a38382 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:51.622759 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-3a54f1e6-2298-41ae-9af7-e96c26a38382 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:51.624647 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-3a54f1e6-2298-41ae-9af7-e96c26a38382 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:51.643886 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d027b0cf-4467-46b3-97c6-53a9187ca012 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:51.683088 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec364bc3-4c92-4829-ab3e-199894c7bfbf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:51.683637 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec364bc3-4c92-4829-ab3e-199894c7bfbf None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:51.683917 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec364bc3-4c92-4829-ab3e-199894c7bfbf None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:51.684188 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec364bc3-4c92-4829-ab3e-199894c7bfbf None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:51.759249 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 377/755] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:51 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:51.760746 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54f1e6-2298-41ae-9af7-e96c26a38382 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:51.765312 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:51.797625 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec364bc3-4c92-4829-ab3e-199894c7bfbf None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:51.800518 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec364bc3-4c92-4829-ab3e-199894c7bfbf None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:51.896868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:51.971223 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3a54f1e6-2298-41ae-9af7-e96c26a38382 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:52.021950 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 379/756] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:52:51 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 543 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:52:52.021950 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec364bc3-4c92-4829-ab3e-199894c7bfbf None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:52.054272 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161259b8-b4ee-496a-a24f-accf01755074 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:52.056282 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161259b8-b4ee-496a-a24f-accf01755074 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:52.056943 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161259b8-b4ee-496a-a24f-accf01755074 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:52.057831 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161259b8-b4ee-496a-a24f-accf01755074 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:52.059819 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161259b8-b4ee-496a-a24f-accf01755074 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:52.061456 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161259b8-b4ee-496a-a24f-accf01755074 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:52.064569 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161259b8-b4ee-496a-a24f-accf01755074 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:52.100947 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 378/757] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:51 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:52.104001 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161259b8-b4ee-496a-a24f-accf01755074 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:52.227899 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec364bc3-4c92-4829-ab3e-199894c7bfbf None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:52.241815 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:52.289673 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57714109-f04d-4192-bf4a-7b1cfb2c8767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:52.291238 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57714109-f04d-4192-bf4a-7b1cfb2c8767 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:52.291238 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57714109-f04d-4192-bf4a-7b1cfb2c8767 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:52.291768 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57714109-f04d-4192-bf4a-7b1cfb2c8767 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:52.301222 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57714109-f04d-4192-bf4a-7b1cfb2c8767 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:52.303094 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57714109-f04d-4192-bf4a-7b1cfb2c8767 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:52.305585 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161259b8-b4ee-496a-a24f-accf01755074 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:52.316745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-57714109-f04d-4192-bf4a-7b1cfb2c8767 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:52.316745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:52.316745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:52.316745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:52.316745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:52.316745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:52.316745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:52.316745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:52.316745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:52.316745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:52.316745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:52.316745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:52.316745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:52.316745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:52.316745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:52.318597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:52.318597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:52.318597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:52.318597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:52.318597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:52.318597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:52.318597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:52.318597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:52.318597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:52.318597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:52.318597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:52.318597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:52.318597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:52.318597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:52.318597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:52.318597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:52.318597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:52.321149 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:52.321149 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:52.321149 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:52.321149 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:52.321149 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:52.321149 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:52.321149 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:52.321149 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:52.321149 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 380/758] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:52.321149 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57714109-f04d-4192-bf4a-7b1cfb2c8767 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:52.339997 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:52.361326 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844715d9-7ce4-4246-970e-07188e17b6d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:52.362138 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844715d9-7ce4-4246-970e-07188e17b6d2 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:52.362554 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844715d9-7ce4-4246-970e-07188e17b6d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:52.362948 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-844715d9-7ce4-4246-970e-07188e17b6d2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:52.377400 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844715d9-7ce4-4246-970e-07188e17b6d2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:52.379628 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-844715d9-7ce4-4246-970e-07188e17b6d2 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:52.407183 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-844715d9-7ce4-4246-970e-07188e17b6d2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:52.407183 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:52.407183 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:52.407183 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:52.407183 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:52.407183 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:52.407183 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:52.407183 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:52.407183 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:52.407183 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:52.407183 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:52.407183 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:52.407183 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:52.407183 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:52.407183 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:52.407183 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:52.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:52.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:52.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:52.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:52.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:52.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:52.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:52.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:52.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:52.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:52.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:52.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:52.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:52.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:52.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:52.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:52.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:52.409415 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:52.409415 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:52.409415 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:52.413261 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 379/759] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:52 2022] GET /identity/v3/domains/Default => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:52.414982 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844715d9-7ce4-4246-970e-07188e17b6d2 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:52.490787 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57714109-f04d-4192-bf4a-7b1cfb2c8767 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:52.548233 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1fb7c-3965-4da2-8ae3-8df05b69095d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:52.549069 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1fb7c-3965-4da2-8ae3-8df05b69095d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:52.549532 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1fb7c-3965-4da2-8ae3-8df05b69095d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:52.549989 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1af1fb7c-3965-4da2-8ae3-8df05b69095d None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:52.561540 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1fb7c-3965-4da2-8ae3-8df05b69095d None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:52.563771 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1af1fb7c-3965-4da2-8ae3-8df05b69095d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:52.583070 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-1af1fb7c-3965-4da2-8ae3-8df05b69095d None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:52.583070 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:52.583070 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:52.583070 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:52.583070 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:52.583070 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:52.583070 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:52.583070 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:52.583070 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:52.583070 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:52.583070 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:52.583070 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:52.583070 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:52.583070 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:52.583070 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:52.584957 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:52.584957 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:52.584957 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:52.584957 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:52.584957 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:52.584957 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:52.584957 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:52.584957 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:52.584957 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:52.584957 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:52.584957 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:52.584957 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:52.584957 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:52.584957 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:52.584957 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:52.584957 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:52.584957 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:52.586970 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:52.586970 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:52.586970 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:52.586970 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:52.586970 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:52.586970 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:52.586970 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:52.586970 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:52.592212 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 381/760] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:52 2022] GET /identity/v3/projects/service => generated 88 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:52.593702 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1fb7c-3965-4da2-8ae3-8df05b69095d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:52.613115 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-844715d9-7ce4-4246-970e-07188e17b6d2 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:52.641380 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:52.679687 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288c505-8317-4b98-9d60-31249754ac60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:52.680678 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288c505-8317-4b98-9d60-31249754ac60 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:52.681245 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288c505-8317-4b98-9d60-31249754ac60 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:52.681572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9288c505-8317-4b98-9d60-31249754ac60 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:52.682377 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288c505-8317-4b98-9d60-31249754ac60 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:52.684950 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9288c505-8317-4b98-9d60-31249754ac60 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:52.700876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-9288c505-8317-4b98-9d60-31249754ac60 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 00:52:52.700876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:52.700876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:52:52.700876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:52:52.700876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:52:52.700876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:52:52.700876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:52:52.700876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:52.700876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 00:52:52.700876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:52.700876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:52.700876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:52.700876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:52.700876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:52.700876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:52.700876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:52.700876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:52.702725 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:52.702725 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:52.702725 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:52.702725 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:52.702725 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:52.702725 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:52.702725 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:52:52.702725 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:52:52.702725 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:52:52.702725 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:52:52.702725 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:52.702725 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:52.702725 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:52.702725 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:52.702725 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:52.702725 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:52.705349 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:52.705349 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:52.705349 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:52.705349 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:52.705349 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:52.705349 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:52.705349 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:52.705349 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:52.705349 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:52.705349 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:52.705349 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:52:52.705349 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:52.705349 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 00:52:52.705349 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:52.705349 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 380/761] 10.222.0.49 () {56 vars in 1129 bytes} [Sun Aug 21 00:52:52 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:52.706915 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288c505-8317-4b98-9d60-31249754ac60 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:52.714001 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:52.777673 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1af1fb7c-3965-4da2-8ae3-8df05b69095d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:52.839147 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6db122-9190-42e3-9735-a1f63f12fb78 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:52.840135 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6db122-9190-42e3-9735-a1f63f12fb78 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:52.840574 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6db122-9190-42e3-9735-a1f63f12fb78 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:52.841012 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe6db122-9190-42e3-9735-a1f63f12fb78 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:52.842252 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6db122-9190-42e3-9735-a1f63f12fb78 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:52.842737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6db122-9190-42e3-9735-a1f63f12fb78 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:52.844921 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe6db122-9190-42e3-9735-a1f63f12fb78 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:52.874156 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 382/762] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:52.874156 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6db122-9190-42e3-9735-a1f63f12fb78 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:52.898807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9288c505-8317-4b98-9d60-31249754ac60 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:52.956856 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b3e84-1724-452e-b19d-56c5e9b69ec7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:52.957648 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b3e84-1724-452e-b19d-56c5e9b69ec7 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:52.958006 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b3e84-1724-452e-b19d-56c5e9b69ec7 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:52.958345 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-197b3e84-1724-452e-b19d-56c5e9b69ec7 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:52.959091 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b3e84-1724-452e-b19d-56c5e9b69ec7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:52.959459 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b3e84-1724-452e-b19d-56c5e9b69ec7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:52.961407 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-197b3e84-1724-452e-b19d-56c5e9b69ec7 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:52.977523 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 381/763] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:52 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:52.979150 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b3e84-1724-452e-b19d-56c5e9b69ec7 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:53.035873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:53.059703 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe6db122-9190-42e3-9735-a1f63f12fb78 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:53.103829 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-197b3e84-1724-452e-b19d-56c5e9b69ec7 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:53.105393 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:53.121071 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43149a-e8d4-4379-9da7-eba780443003 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:53.122049 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43149a-e8d4-4379-9da7-eba780443003 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:53.122435 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43149a-e8d4-4379-9da7-eba780443003 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:53.122881 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed43149a-e8d4-4379-9da7-eba780443003 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:53.124024 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed43149a-e8d4-4379-9da7-eba780443003 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:53.124417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed43149a-e8d4-4379-9da7-eba780443003 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:53.127286 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed43149a-e8d4-4379-9da7-eba780443003 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:53.146933 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 383/764] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:52 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:53.147929 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43149a-e8d4-4379-9da7-eba780443003 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:53.174123 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90198fff-fa78-47e2-b0d0-7358b81144dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:53.175182 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90198fff-fa78-47e2-b0d0-7358b81144dd None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:53.175664 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90198fff-fa78-47e2-b0d0-7358b81144dd None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:53.176134 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90198fff-fa78-47e2-b0d0-7358b81144dd None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:53.177300 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90198fff-fa78-47e2-b0d0-7358b81144dd None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:53.177830 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90198fff-fa78-47e2-b0d0-7358b81144dd None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:53.180426 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90198fff-fa78-47e2-b0d0-7358b81144dd None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:53.189508 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 382/765] 10.222.0.49 () {56 vars in 1124 bytes} [Sun Aug 21 00:52:52 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 211 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:53.190866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90198fff-fa78-47e2-b0d0-7358b81144dd None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:53.324397 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed43149a-e8d4-4379-9da7-eba780443003 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:53.365368 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42535da-ecd5-4d83-9a83-ddfbb0e7d341 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:53.366075 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42535da-ecd5-4d83-9a83-ddfbb0e7d341 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:53.366449 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42535da-ecd5-4d83-9a83-ddfbb0e7d341 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:53.366776 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42535da-ecd5-4d83-9a83-ddfbb0e7d341 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:53.367639 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42535da-ecd5-4d83-9a83-ddfbb0e7d341 None admin] RBAC: Adding query filter params (role.id=c73e9539582145ed8eedc48648b9d738, scope.project.id=838e996d09a0454b9bcdc5aef03ef203, user.id=f66a877fdca340f48f54b48e5367a194) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:53.368008 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42535da-ecd5-4d83-9a83-ddfbb0e7d341 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:53.369749 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42535da-ecd5-4d83-9a83-ddfbb0e7d341 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:53.373824 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90198fff-fa78-47e2-b0d0-7358b81144dd None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:53.377258 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:53.377699 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 384/766] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:53 2022] GET /identity/v3/role_assignments?user.id=f66a877fdca340f48f54b48e5367a194&scope.project.id=838e996d09a0454b9bcdc5aef03ef203&role.id=c73e9539582145ed8eedc48648b9d738 => generated 259 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:53.379330 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac2113-8e88-4705-8a87-0021ccfdaa52 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:53.379743 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac2113-8e88-4705-8a87-0021ccfdaa52 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:53.380251 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7ac2113-8e88-4705-8a87-0021ccfdaa52 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:53.382286 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 385/767] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:53.383685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac2113-8e88-4705-8a87-0021ccfdaa52 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:53.455640 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:53.465950 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e94cb-4b24-44cc-9800-d35a2e2c5b04 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:53.467532 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e94cb-4b24-44cc-9800-d35a2e2c5b04 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:53.468341 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e94cb-4b24-44cc-9800-d35a2e2c5b04 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:53.469204 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-758e94cb-4b24-44cc-9800-d35a2e2c5b04 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:53.484718 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e94cb-4b24-44cc-9800-d35a2e2c5b04 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:53.488204 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-758e94cb-4b24-44cc-9800-d35a2e2c5b04 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:53.513588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-758e94cb-4b24-44cc-9800-d35a2e2c5b04 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:53.513588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:53.513588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:53.513588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:53.513588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:53.513588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:53.513588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:53.513588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:53.513588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:53.513588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:53.513588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:53.513588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:53.513588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:52:53.513588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:52:53.513588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:52:53.515553 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:52:53.515553 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:53.515553 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:53.515553 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:53.515553 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:53.515553 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:53.515553 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:53.515553 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:53.515553 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:53.515553 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:53.515553 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:53.515553 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:53.515553 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:53.515553 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:53.515553 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:53.515553 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:53.515553 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:53.517595 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:52:53.517595 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:52:53.517595 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:52:53.517595 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:52:53.517595 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:52:53.517595 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:52:53.517595 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:52:53.517595 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:53.521136 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 383/768] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:53 2022] GET /identity/v3/projects/service => generated 88 bytes in 331 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:53.523111 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e94cb-4b24-44cc-9800-d35a2e2c5b04 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:53.536499 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7ac2113-8e88-4705-8a87-0021ccfdaa52 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:53.607534 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61734cc2-8759-4ce7-ad26-db2fdac3e8c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:53.607827 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61734cc2-8759-4ce7-ad26-db2fdac3e8c5 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:53.608151 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61734cc2-8759-4ce7-ad26-db2fdac3e8c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:53.608628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61734cc2-8759-4ce7-ad26-db2fdac3e8c5 None admin] PATH_INFO: `/v3/projects/838e996d09a0454b9bcdc5aef03ef203/users/6b003ae4a082485ab608bf84c1657159/roles/c73e9539582145ed8eedc48648b9d738` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:53.612476 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61734cc2-8759-4ce7-ad26-db2fdac3e8c5 None admin] RBAC: Authorizing `identity:create_grant(project_id=838e996d09a0454b9bcdc5aef03ef203, user_id=6b003ae4a082485ab608bf84c1657159, role_id=c73e9539582145ed8eedc48648b9d738)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:53.615326 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61734cc2-8759-4ce7-ad26-db2fdac3e8c5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:53.642384 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 386/769] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 21 00:52:53 2022] PUT /identity/v3/projects/838e996d09a0454b9bcdc5aef03ef203/users/6b003ae4a082485ab608bf84c1657159/roles/c73e9539582145ed8eedc48648b9d738 => generated 0 bytes in 260 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:52:53.644627 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb7670-d92e-4f88-94a7-20546557ef2a None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:53.645229 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb7670-d92e-4f88-94a7-20546557ef2a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:53.645704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edbb7670-d92e-4f88-94a7-20546557ef2a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:53.679700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-edbb7670-d92e-4f88-94a7-20546557ef2a None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:53.682054 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-edbb7670-d92e-4f88-94a7-20546557ef2a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:53.770828 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-758e94cb-4b24-44cc-9800-d35a2e2c5b04 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:53.838157 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 387/770] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:53 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:53.840584 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb7670-d92e-4f88-94a7-20546557ef2a None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:53.852941 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb62f2-3e40-48c2-9cb2-2bbb9d8f1856 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:53.854702 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb62f2-3e40-48c2-9cb2-2bbb9d8f1856 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:53.855588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb62f2-3e40-48c2-9cb2-2bbb9d8f1856 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:53.856347 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bdb62f2-3e40-48c2-9cb2-2bbb9d8f1856 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:53.858040 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb62f2-3e40-48c2-9cb2-2bbb9d8f1856 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:53.858921 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb62f2-3e40-48c2-9cb2-2bbb9d8f1856 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:53.862907 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3bdb62f2-3e40-48c2-9cb2-2bbb9d8f1856 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:53.876191 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 384/771] 10.222.0.49 () {56 vars in 1124 bytes} [Sun Aug 21 00:52:53 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 354 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:53.886103 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb62f2-3e40-48c2-9cb2-2bbb9d8f1856 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:53.946837 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:53.964572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:54.081148 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edbb7670-d92e-4f88-94a7-20546557ef2a None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:54.144784 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81fc99-f306-4584-b3e8-cc5e3dd08134 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:54.145804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81fc99-f306-4584-b3e8-cc5e3dd08134 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:54.146306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81fc99-f306-4584-b3e8-cc5e3dd08134 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:54.146793 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db81fc99-f306-4584-b3e8-cc5e3dd08134 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:54.148135 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81fc99-f306-4584-b3e8-cc5e3dd08134 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:54.148686 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81fc99-f306-4584-b3e8-cc5e3dd08134 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:54.151627 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db81fc99-f306-4584-b3e8-cc5e3dd08134 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:54.171028 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3bdb62f2-3e40-48c2-9cb2-2bbb9d8f1856 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:54.175537 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 388/772] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:52:53 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:54.187206 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81fc99-f306-4584-b3e8-cc5e3dd08134 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:54.281639 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b764e-7881-47c7-8487-145b1e4502b1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:54.283183 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b764e-7881-47c7-8487-145b1e4502b1 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:54.283993 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b764e-7881-47c7-8487-145b1e4502b1 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:54.284759 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b5b764e-7881-47c7-8487-145b1e4502b1 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:54.286512 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b764e-7881-47c7-8487-145b1e4502b1 None admin] RBAC: Adding query filter params (interface=public, service_id=b034ccc870c04f4981c65c160e1a2b87, region_id=RegionOne) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:54.287416 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b764e-7881-47c7-8487-145b1e4502b1 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:54.290417 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b5b764e-7881-47c7-8487-145b1e4502b1 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:54.307439 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 385/773] 10.222.0.49 () {56 vars in 1251 bytes} [Sun Aug 21 00:52:53 2022] GET /identity/v3/endpoints?service_id=b034ccc870c04f4981c65c160e1a2b87&interface=public®ion_id=RegionOne => generated 194 bytes in 422 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:54.326770 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b764e-7881-47c7-8487-145b1e4502b1 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:54.491565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db81fc99-f306-4584-b3e8-cc5e3dd08134 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:54.517651 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:54.551356 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:54.560686 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8849ad9-f4b2-4992-849a-d0adbb0b792b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:54.561785 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8849ad9-f4b2-4992-849a-d0adbb0b792b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:54.562277 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8849ad9-f4b2-4992-849a-d0adbb0b792b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:54.562745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e8849ad9-f4b2-4992-849a-d0adbb0b792b None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:54.564572 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8849ad9-f4b2-4992-849a-d0adbb0b792b None admin] RBAC: Adding query filter params (role.id=b549ba322af24099825f8949d2060adf, scope.project.id=838e996d09a0454b9bcdc5aef03ef203, user.id=a06f043017114f9090264293f5ede6c4) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:54.564784 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8849ad9-f4b2-4992-849a-d0adbb0b792b None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:54.567575 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e8849ad9-f4b2-4992-849a-d0adbb0b792b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:54.576941 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b5b764e-7881-47c7-8487-145b1e4502b1 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:54.585093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 389/774] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:52:54 2022] GET /identity/v3/role_assignments?user.id=a06f043017114f9090264293f5ede6c4&scope.project.id=838e996d09a0454b9bcdc5aef03ef203&role.id=b549ba322af24099825f8949d2060adf => generated 259 bytes in 392 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:52:54.585093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8849ad9-f4b2-4992-849a-d0adbb0b792b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:54.726354 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355e396-9068-41b1-8fa5-3b4274e713dc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:54.728038 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355e396-9068-41b1-8fa5-3b4274e713dc None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:54.728877 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355e396-9068-41b1-8fa5-3b4274e713dc None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:54.729773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6355e396-9068-41b1-8fa5-3b4274e713dc None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:54.731227 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355e396-9068-41b1-8fa5-3b4274e713dc None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:54.741091 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6355e396-9068-41b1-8fa5-3b4274e713dc None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:54.769353 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 386/775] 10.222.0.49 () {56 vars in 1087 bytes} [Sun Aug 21 00:52:54 2022] GET /identity/v3/services => generated 772 bytes in 437 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:54.793865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e8849ad9-f4b2-4992-849a-d0adbb0b792b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:54.862500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633ae38-ff9f-4544-8cd0-28ef293fbfa9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:54.863508 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633ae38-ff9f-4544-8cd0-28ef293fbfa9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:54.863981 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633ae38-ff9f-4544-8cd0-28ef293fbfa9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:54.864452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e633ae38-ff9f-4544-8cd0-28ef293fbfa9 None admin] PATH_INFO: `/v3/services/network` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:54.865606 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633ae38-ff9f-4544-8cd0-28ef293fbfa9 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:54.868661 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e633ae38-ff9f-4544-8cd0-28ef293fbfa9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:54.887053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-e633ae38-ff9f-4544-8cd0-28ef293fbfa9 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 00:52:54.887053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:54.887053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:52:54.887053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:52:54.887053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:52:54.887053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:52:54.887053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:52:54.887053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:54.887053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 00:52:54.887053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:54.887053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:52:54.887053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:54.887053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:54.887053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:54.887053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:54.887053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:54.887053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:54.888980 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:54.888980 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:54.888980 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:54.888980 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:54.888980 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:54.888980 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:54.888980 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:52:54.888980 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:52:54.888980 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:52:54.888980 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:52:54.888980 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:54.888980 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:54.888980 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:54.888980 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:54.888980 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:54.888980 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:54.891813 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:54.891813 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:54.891813 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:54.891813 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:54.891813 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:54.891813 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:54.891813 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:54.891813 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:54.891813 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:54.891813 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:54.891813 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:52:54.891813 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:52:54.891813 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 00:52:54.891813 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:54.891813 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 390/776] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:52:54 2022] GET /identity/v3/services/network => generated 88 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:54.900365 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355e396-9068-41b1-8fa5-3b4274e713dc None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:55.112694 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6355e396-9068-41b1-8fa5-3b4274e713dc None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:55.178959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6d466-5e68-4eac-a528-f1957308edea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:55.179986 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6d466-5e68-4eac-a528-f1957308edea None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:55.180469 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6d466-5e68-4eac-a528-f1957308edea None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:55.180937 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38b6d466-5e68-4eac-a528-f1957308edea None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:55.182124 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6d466-5e68-4eac-a528-f1957308edea None admin] RBAC: Adding query filter params (name=network) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:55.182708 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6d466-5e68-4eac-a528-f1957308edea None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:55.185378 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38b6d466-5e68-4eac-a528-f1957308edea None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:55.194781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 387/777] 10.222.0.49 () {56 vars in 1112 bytes} [Sun Aug 21 00:52:54 2022] GET /identity/v3/services?name=network => generated 124 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:55.204063 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633ae38-ff9f-4544-8cd0-28ef293fbfa9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:55.263070 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:55.454779 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e633ae38-ff9f-4544-8cd0-28ef293fbfa9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:55.541652 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc36a1-ede9-486e-9cd8-da0c88e131ef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:55.543257 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc36a1-ede9-486e-9cd8-da0c88e131ef None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:55.544033 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc36a1-ede9-486e-9cd8-da0c88e131ef None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:55.544833 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26bc36a1-ede9-486e-9cd8-da0c88e131ef None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:55.546372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc36a1-ede9-486e-9cd8-da0c88e131ef None admin] RBAC: Adding query filter params (type=network) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:55.547351 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc36a1-ede9-486e-9cd8-da0c88e131ef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:55.550283 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26bc36a1-ede9-486e-9cd8-da0c88e131ef None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:55.564725 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 391/778] 10.222.0.49 () {56 vars in 1112 bytes} [Sun Aug 21 00:52:55 2022] GET /identity/v3/services?type=network => generated 350 bytes in 362 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:55.574657 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6d466-5e68-4eac-a528-f1957308edea None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:55.620669 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:55.793845 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38b6d466-5e68-4eac-a528-f1957308edea None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:55.861539 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d24c42ad-b689-437e-95e7-92e803e83937 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:55.862543 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c42ad-b689-437e-95e7-92e803e83937 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:55.862963 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c42ad-b689-437e-95e7-92e803e83937 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:55.863413 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d24c42ad-b689-437e-95e7-92e803e83937 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:55.864583 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c42ad-b689-437e-95e7-92e803e83937 None admin] RBAC: Adding query filter params (interface=public, service_id=255b918325d144c88bfe7a7ef6eaf756, region_id=RegionOne) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:55.864945 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c42ad-b689-437e-95e7-92e803e83937 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:55.866417 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d24c42ad-b689-437e-95e7-92e803e83937 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:55.875852 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 388/779] 10.222.0.49 () {56 vars in 1251 bytes} [Sun Aug 21 00:52:55 2022] GET /identity/v3/endpoints?service_id=255b918325d144c88bfe7a7ef6eaf756&interface=public®ion_id=RegionOne => generated 194 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:55.885416 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc36a1-ede9-486e-9cd8-da0c88e131ef None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:56.076144 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:56.094812 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26bc36a1-ede9-486e-9cd8-da0c88e131ef None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:56.190346 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d600aab-08ba-410c-ae59-ac6073dc3ab2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:56.191418 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d600aab-08ba-410c-ae59-ac6073dc3ab2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:56.191895 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d600aab-08ba-410c-ae59-ac6073dc3ab2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:56.192379 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d600aab-08ba-410c-ae59-ac6073dc3ab2 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:56.193557 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d600aab-08ba-410c-ae59-ac6073dc3ab2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:56.196172 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d600aab-08ba-410c-ae59-ac6073dc3ab2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:56.207116 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 392/780] 10.222.0.49 () {56 vars in 1087 bytes} [Sun Aug 21 00:52:55 2022] GET /identity/v3/services => generated 772 bytes in 323 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:56.899949 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7944b-830b-4ba4-80c6-123fd2790d21 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:56.900777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7944b-830b-4ba4-80c6-123fd2790d21 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:56.900909 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ba7944b-830b-4ba4-80c6-123fd2790d21 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:56.907952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 389/781] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:56 2022] GET /identity => generated 270 bytes in 10 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:56.914397 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374dd58-2aad-4151-bfd7-b0f92338afae None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:56.915312 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374dd58-2aad-4151-bfd7-b0f92338afae None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:56.915312 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4374dd58-2aad-4151-bfd7-b0f92338afae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:56.955951 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-4374dd58-2aad-4151-bfd7-b0f92338afae None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:56.957940 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-4374dd58-2aad-4151-bfd7-b0f92338afae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:57.103547 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 393/782] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:56 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:57.657779 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7944b-830b-4ba4-80c6-123fd2790d21 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:57.846141 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6328b42-c2b3-44dc-91e3-1b5799fbcdaf None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:57.846587 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6328b42-c2b3-44dc-91e3-1b5799fbcdaf None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:57.847021 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6328b42-c2b3-44dc-91e3-1b5799fbcdaf None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:57.849942 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 394/783] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:57 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:57.863452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bb514-2e11-43b3-952a-8e9e0be5e1b7 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:57.863908 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bb514-2e11-43b3-952a-8e9e0be5e1b7 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:57.864314 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a67bb514-2e11-43b3-952a-8e9e0be5e1b7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:57.864959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:57.922854 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-a67bb514-2e11-43b3-952a-8e9e0be5e1b7 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:57.925192 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a67bb514-2e11-43b3-952a-8e9e0be5e1b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:57.938268 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ba7944b-830b-4ba4-80c6-123fd2790d21 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:58.069559 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 395/784] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:57 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:52:58.073612 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d00be-8919-46de-96b7-2a35a19d928e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:58.075162 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d00be-8919-46de-96b7-2a35a19d928e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:58.075925 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d00be-8919-46de-96b7-2a35a19d928e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:58.076789 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c25d00be-8919-46de-96b7-2a35a19d928e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:58.101292 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c25d00be-8919-46de-96b7-2a35a19d928e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:58.111450 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-c25d00be-8919-46de-96b7-2a35a19d928e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:52:58.111450 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:58.111450 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:58.111450 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:58.111450 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:58.111450 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:58.111450 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:58.111450 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:58.111450 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:58.111450 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:58.111450 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:58.111450 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:58.111450 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:58.111450 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:58.111450 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:58.111450 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:58.113341 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:58.113341 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:58.113341 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:58.113341 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:58.113341 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:58.113341 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:58.113341 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:58.113341 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:58.113341 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:58.113341 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:58.113341 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:58.113341 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:58.113341 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:58.113341 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:58.113341 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:58.113341 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:58.114989 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:58.114989 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:58.114989 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:58.114989 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:58.114989 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:58.114989 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:58.114989 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:58.114989 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:58.114989 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:58.114989 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:58.114989 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:52:58.114989 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:58.119965 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 390/785] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:52:57 2022] GET /identity/v3/roles/admin => generated 83 bytes in 463 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:58.129471 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bb514-2e11-43b3-952a-8e9e0be5e1b7 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:58.162966 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:58.334165 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a67bb514-2e11-43b3-952a-8e9e0be5e1b7 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:58.411121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cb92f-4987-443d-8472-8075d84b7e27 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:58.412209 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cb92f-4987-443d-8472-8075d84b7e27 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:58.412702 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cb92f-4987-443d-8472-8075d84b7e27 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:58.413231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3cb92f-4987-443d-8472-8075d84b7e27 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:58.414533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cb92f-4987-443d-8472-8075d84b7e27 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:58.415085 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cb92f-4987-443d-8472-8075d84b7e27 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:58.417909 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b3cb92f-4987-443d-8472-8075d84b7e27 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:58.439989 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 396/786] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:52:58 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:58.448669 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d00be-8919-46de-96b7-2a35a19d928e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:58.690188 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c25d00be-8919-46de-96b7-2a35a19d928e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:58.698742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cb92f-4987-443d-8472-8075d84b7e27 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:58.794216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83e51d74-03cb-45cb-844a-89ca6d965d76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:58.797841 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e51d74-03cb-45cb-844a-89ca6d965d76 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:58.798301 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e51d74-03cb-45cb-844a-89ca6d965d76 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:58.798610 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83e51d74-03cb-45cb-844a-89ca6d965d76 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:58.838414 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e51d74-03cb-45cb-844a-89ca6d965d76 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:58.840801 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83e51d74-03cb-45cb-844a-89ca6d965d76 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:58.852467 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:58.882598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-83e51d74-03cb-45cb-844a-89ca6d965d76 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:58.882598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:58.882598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:58.882598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:58.882598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:58.882598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:58.882598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:58.882598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:58.882598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:58.882598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:58.882598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:58.882598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:58.882598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:52:58.882598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:52:58.882598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:52:58.882598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:52:58.884429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:58.884429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:58.884429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:58.884429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:58.884429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:58.884429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:58.884429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:58.884429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:58.884429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:58.884429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:58.884429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:58.884429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:58.884429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:58.884429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:58.884429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:58.884429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:58.884429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:52:58.887299 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:52:58.887299 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:52:58.887299 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:52:58.887299 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 391/787] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 437 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:58.887299 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa47821-cd21-4dff-98a3-0ec712b612df None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:58.888419 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa47821-cd21-4dff-98a3-0ec712b612df None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:58.888419 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa47821-cd21-4dff-98a3-0ec712b612df None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:58.893168 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 392/788] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:58 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:58.895396 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa47821-cd21-4dff-98a3-0ec712b612df None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:58.928161 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:58.969884 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3cb92f-4987-443d-8472-8075d84b7e27 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:59.036237 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d56bb40-4dbb-4f0f-b4e0-da158c8fce56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:59.037287 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56bb40-4dbb-4f0f-b4e0-da158c8fce56 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:59.037732 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56bb40-4dbb-4f0f-b4e0-da158c8fce56 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:59.038186 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d56bb40-4dbb-4f0f-b4e0-da158c8fce56 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:59.058938 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8d56bb40-4dbb-4f0f-b4e0-da158c8fce56 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:52:59.069788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-8d56bb40-4dbb-4f0f-b4e0-da158c8fce56 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:52:59.069788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:59.069788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:59.069788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:59.069788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:59.069788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:59.069788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:59.069788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:59.069788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:59.069788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:59.069788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:59.069788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:59.069788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:52:59.069788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:52:59.069788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:52:59.069788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:52:59.071532 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:52:59.071532 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:52:59.071532 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:52:59.071532 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:52:59.071532 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:59.071532 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:59.071532 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:59.071532 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:59.071532 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:59.071532 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:59.071532 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:59.071532 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:59.071532 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:59.071532 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:59.071532 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:59.071532 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:59.073829 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:59.073829 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:59.073829 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:59.073829 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:59.073829 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:52:59.073829 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:52:59.073829 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:52:59.073829 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:52:59.073829 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:52:59.073829 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:52:59.073829 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:52:59.073829 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:59.073829 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 397/789] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:52:58 2022] GET /identity/v3/roles/admin => generated 83 bytes in 374 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:59.076315 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d2008-88d4-49bb-b55c-2d54b7fa06f4 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:59.076315 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d2008-88d4-49bb-b55c-2d54b7fa06f4 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:59.076315 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f23d2008-88d4-49bb-b55c-2d54b7fa06f4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:59.107524 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-f23d2008-88d4-49bb-b55c-2d54b7fa06f4 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:59.109620 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f23d2008-88d4-49bb-b55c-2d54b7fa06f4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:59.121686 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa47821-cd21-4dff-98a3-0ec712b612df None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:59.191914 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c61f4-5dc8-4f9a-9d42-2bab22f8bb3b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:59.192923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c61f4-5dc8-4f9a-9d42-2bab22f8bb3b None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:59.193717 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c61f4-5dc8-4f9a-9d42-2bab22f8bb3b None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:59.193991 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-af7c61f4-5dc8-4f9a-9d42-2bab22f8bb3b None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:59.194861 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c61f4-5dc8-4f9a-9d42-2bab22f8bb3b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:59.195336 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c61f4-5dc8-4f9a-9d42-2bab22f8bb3b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:59.197794 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-af7c61f4-5dc8-4f9a-9d42-2bab22f8bb3b None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:59.220828 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 393/790] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:52:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:59.222225 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c61f4-5dc8-4f9a-9d42-2bab22f8bb3b None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:59.248502 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 398/791] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:59.258472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d2008-88d4-49bb-b55c-2d54b7fa06f4 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:59.349631 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:59.414604 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:59.430811 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-af7c61f4-5dc8-4f9a-9d42-2bab22f8bb3b None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:59.490427 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f23d2008-88d4-49bb-b55c-2d54b7fa06f4 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:59.571545 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1ca53fd-6b17-4079-86f5-3dd6bf4a0af2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:59.573333 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca53fd-6b17-4079-86f5-3dd6bf4a0af2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:59.574108 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca53fd-6b17-4079-86f5-3dd6bf4a0af2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:59.574833 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1ca53fd-6b17-4079-86f5-3dd6bf4a0af2 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:59.590909 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca53fd-6b17-4079-86f5-3dd6bf4a0af2 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:59.594189 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1ca53fd-6b17-4079-86f5-3dd6bf4a0af2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:59.618992 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-f1ca53fd-6b17-4079-86f5-3dd6bf4a0af2 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:52:59.618992 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:52:59.618992 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:52:59.618992 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:52:59.618992 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:52:59.618992 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:52:59.618992 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:52:59.618992 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:52:59.618992 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:52:59.618992 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:52:59.618992 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:52:59.618992 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:52:59.618992 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:52:59.618992 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:52:59.618992 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:52:59.618992 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:52:59.621372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:52:59.621372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:52:59.621372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:52:59.621372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:59.621372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:52:59.621372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:52:59.621372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:52:59.621372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:52:59.621372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:52:59.621372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:52:59.621372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:52:59.621372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:52:59.621372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:52:59.621372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:52:59.621372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:52:59.621372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:52:59.621372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:52:59.621372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:52:59.623633 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:52:59.623633 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:52:59.623633 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:52:59.623633 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:52:59.623633 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:52:59.623633 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:52:59.623633 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:52:59.623633 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:52:59.623633 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:52:59.623633 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:52:59.627788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 399/792] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:52:59 2022] GET /identity/v3/users/swift => generated 83 bytes in 379 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:52:59.630573 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7819b8-9cff-4ab5-8d4a-6462dc97197b None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:59.631356 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7819b8-9cff-4ab5-8d4a-6462dc97197b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:59.632051 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b7819b8-9cff-4ab5-8d4a-6462dc97197b None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:59.635325 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 400/793] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:52:59 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:52:59.637175 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7819b8-9cff-4ab5-8d4a-6462dc97197b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:59.687634 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed313741-0412-4478-920e-d57de4404086 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:59.688789 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed313741-0412-4478-920e-d57de4404086 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:59.688978 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed313741-0412-4478-920e-d57de4404086 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:59.689235 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed313741-0412-4478-920e-d57de4404086 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:59.690392 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed313741-0412-4478-920e-d57de4404086 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:59.690920 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed313741-0412-4478-920e-d57de4404086 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:59.693398 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed313741-0412-4478-920e-d57de4404086 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:59.710292 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 394/794] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:52:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 489 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:59.712065 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe15e6-a7fe-464c-b51a-c6ac386c5ac2 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:59.713753 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe15e6-a7fe-464c-b51a-c6ac386c5ac2 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:59.713753 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86fe15e6-a7fe-464c-b51a-c6ac386c5ac2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:59.749148 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-86fe15e6-a7fe-464c-b51a-c6ac386c5ac2 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:52:59.752199 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-86fe15e6-a7fe-464c-b51a-c6ac386c5ac2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:52:59.851604 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b7819b8-9cff-4ab5-8d4a-6462dc97197b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:52:59.905111 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 395/795] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:52:59 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:52:59.905111 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe15e6-a7fe-464c-b51a-c6ac386c5ac2 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:52:59.922569 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:52:59.941162 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab5fd6-1e3f-47e8-a4b1-4a77380f2779 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:52:59.942156 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab5fd6-1e3f-47e8-a4b1-4a77380f2779 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:52:59.942510 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab5fd6-1e3f-47e8-a4b1-4a77380f2779 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:52:59.942915 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ab5fd6-1e3f-47e8-a4b1-4a77380f2779 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:52:59.944095 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab5fd6-1e3f-47e8-a4b1-4a77380f2779 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:52:59.944559 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab5fd6-1e3f-47e8-a4b1-4a77380f2779 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:52:59.948938 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ab5fd6-1e3f-47e8-a4b1-4a77380f2779 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:52:59.986213 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 401/796] 10.222.0.49 () {56 vars in 1135 bytes} [Sun Aug 21 00:52:59 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 349 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:52:59.988808 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab5fd6-1e3f-47e8-a4b1-4a77380f2779 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:00.007793 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:00.128892 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86fe15e6-a7fe-464c-b51a-c6ac386c5ac2 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:00.208888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeea541-fe29-4cc4-8e27-b80d4be2e07f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:00.210393 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeea541-fe29-4cc4-8e27-b80d4be2e07f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:00.211145 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeea541-fe29-4cc4-8e27-b80d4be2e07f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:00.211715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daeea541-fe29-4cc4-8e27-b80d4be2e07f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:00.247465 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeea541-fe29-4cc4-8e27-b80d4be2e07f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:00.248593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ab5fd6-1e3f-47e8-a4b1-4a77380f2779 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:00.250619 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daeea541-fe29-4cc4-8e27-b80d4be2e07f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:00.286421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-daeea541-fe29-4cc4-8e27-b80d4be2e07f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:00.286421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:00.286421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:00.286421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:00.286421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:00.286421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:00.286421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:00.286421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:00.286421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:00.286421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:00.286421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:00.286421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:00.286421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:00.286421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:00.286421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:00.286421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:00.288234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:00.288234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:00.288234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:00.288234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:00.288234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:00.288234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:00.288234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:00.288234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:00.288234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:00.288234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:00.288234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:00.288234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:00.288234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:00.288234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:00.288234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:00.288234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:00.288234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:00.289903 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:00.289903 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:00.289903 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:00.293867 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 396/797] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:52:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 393 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:00.295792 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeea541-fe29-4cc4-8e27-b80d4be2e07f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:00.335821 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087b69a-a391-44fa-aa1f-c517a38f7dea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:00.337552 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087b69a-a391-44fa-aa1f-c517a38f7dea None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:00.338409 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087b69a-a391-44fa-aa1f-c517a38f7dea None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:00.339183 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3087b69a-a391-44fa-aa1f-c517a38f7dea None admin] PATH_INFO: `/v3/roles/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:00.361797 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3087b69a-a391-44fa-aa1f-c517a38f7dea None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:53:00.374598 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-3087b69a-a391-44fa-aa1f-c517a38f7dea None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:53:00.374598 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:00.374598 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:00.374598 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:00.374598 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:00.374598 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:00.374598 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:00.374598 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:00.374598 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:00.374598 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:00.374598 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:00.374598 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:00.374598 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:53:00.374598 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:53:00.374598 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:53:00.374598 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:53:00.377254 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:53:00.377254 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:53:00.377254 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:53:00.377254 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:53:00.377254 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:00.377254 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:00.377254 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:00.377254 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:00.377254 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:00.377254 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:00.377254 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:00.377254 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:00.377254 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:00.377254 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:00.377254 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:00.377254 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:00.378742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:00.378742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:00.378742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:00.378742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:00.378742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:53:00.378742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:53:00.378742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:53:00.378742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:53:00.378742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:53:00.378742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:53:00.378742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:53:00.378742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:00.378742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 402/798] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 21 00:52:59 2022] GET /identity/v3/roles/service => generated 85 bytes in 391 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:00.381458 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087b69a-a391-44fa-aa1f-c517a38f7dea None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:00.474311 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:00.502973 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:00.509522 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daeea541-fe29-4cc4-8e27-b80d4be2e07f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:00.570676 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3087b69a-a391-44fa-aa1f-c517a38f7dea None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:00.571140 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26822e-2064-4764-ab74-e5c415e441f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:00.572122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26822e-2064-4764-ab74-e5c415e441f9 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:00.572545 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26822e-2064-4764-ab74-e5c415e441f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:00.572959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa26822e-2064-4764-ab74-e5c415e441f9 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:00.586279 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26822e-2064-4764-ab74-e5c415e441f9 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:00.588005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fa26822e-2064-4764-ab74-e5c415e441f9 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:00.607298 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-fa26822e-2064-4764-ab74-e5c415e441f9 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:00.607298 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:00.607298 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:00.607298 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:00.607298 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:00.607298 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:00.607298 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:00.607298 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:00.607298 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:00.607298 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:00.607298 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:00.607298 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:00.607298 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:00.607298 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:00.607298 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:00.607298 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:00.609266 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:00.609266 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:00.609266 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:00.609266 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:00.609266 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:00.609266 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:00.609266 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:00.609266 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:00.609266 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:00.609266 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:00.609266 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:00.609266 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:00.609266 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:00.609266 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:00.609266 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:00.609266 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:00.609266 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:00.611383 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:00.611383 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:00.611383 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:00.611383 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 397/799] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:00 2022] GET /identity/v3/domains/Default => generated 87 bytes in 315 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:00.611383 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26822e-2064-4764-ab74-e5c415e441f9 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:00.639042 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94980f0e-fe7f-4804-9755-39b5d44f2e6d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:00.640067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94980f0e-fe7f-4804-9755-39b5d44f2e6d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:00.640551 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94980f0e-fe7f-4804-9755-39b5d44f2e6d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:00.641103 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94980f0e-fe7f-4804-9755-39b5d44f2e6d None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:00.642279 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94980f0e-fe7f-4804-9755-39b5d44f2e6d None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:00.642805 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94980f0e-fe7f-4804-9755-39b5d44f2e6d None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:00.645484 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94980f0e-fe7f-4804-9755-39b5d44f2e6d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:00.664073 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 403/800] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:00.665450 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94980f0e-fe7f-4804-9755-39b5d44f2e6d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:00.771228 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fa26822e-2064-4764-ab74-e5c415e441f9 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:00.804778 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94980f0e-fe7f-4804-9755-39b5d44f2e6d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:00.813456 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:00.839902 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9596f01-7872-4fe9-9f48-c11cec6a7db8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:00.840836 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9596f01-7872-4fe9-9f48-c11cec6a7db8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:00.841382 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9596f01-7872-4fe9-9f48-c11cec6a7db8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:00.841862 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9596f01-7872-4fe9-9f48-c11cec6a7db8 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:00.843129 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9596f01-7872-4fe9-9f48-c11cec6a7db8 None admin] RBAC: Adding query filter params (name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:00.843641 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9596f01-7872-4fe9-9f48-c11cec6a7db8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:00.846368 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9596f01-7872-4fe9-9f48-c11cec6a7db8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:00.847507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f49c19-b1ba-4ee4-9920-1fd6bc206573 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:00.848223 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f49c19-b1ba-4ee4-9920-1fd6bc206573 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:00.848560 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f49c19-b1ba-4ee4-9920-1fd6bc206573 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:00.848886 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6f49c19-b1ba-4ee4-9920-1fd6bc206573 None admin] PATH_INFO: `/v3/services/block-storage` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:00.849651 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f49c19-b1ba-4ee4-9920-1fd6bc206573 None admin] RBAC: Authorizing `identity:get_service(service_id=block-storage)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:00.851326 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6f49c19-b1ba-4ee4-9920-1fd6bc206573 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:00.861631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-d6f49c19-b1ba-4ee4-9920-1fd6bc206573 None admin] Could not find service: block-storage.: keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 00:53:00.861631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:00.861631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:53:00.861631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:53:00.861631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:53:00.861631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:53:00.861631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:53:00.861631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:00.861631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 00:53:00.861631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:00.861631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:53:00.861631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:00.861631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:00.861631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:00.861631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:00.861631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:00.861631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:00.863773 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:00.863773 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:00.863773 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:00.863773 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:00.863773 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:00.863773 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:00.863773 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:53:00.863773 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:53:00.863773 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:53:00.863773 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:53:00.863773 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:00.863773 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:00.863773 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:00.863773 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:00.863773 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:00.863773 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:00.865590 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:00.865590 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:00.865590 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:00.865590 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:00.865590 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:00.865590 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:00.865590 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:00.865590 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:00.865590 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:00.865590 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:00.865590 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:53:00.865590 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:00.865590 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: block-storage. Aug 21 00:53:00.865590 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:00.867124 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 398/801] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 21 00:53:00 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 252 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:00.867124 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2323cc7-1ab2-4b59-9501-108a3255caaa None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:00.867124 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2323cc7-1ab2-4b59-9501-108a3255caaa None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:00.867124 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2323cc7-1ab2-4b59-9501-108a3255caaa None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:00.868703 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 399/802] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:00 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:00.870938 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2323cc7-1ab2-4b59-9501-108a3255caaa None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:00.871186 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 404/803] 10.222.0.49 () {56 vars in 1129 bytes} [Sun Aug 21 00:53:00 2022] GET /identity/v3/services/block-storage => generated 94 bytes in 205 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:00.871726 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f49c19-b1ba-4ee4-9920-1fd6bc206573 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:00.901627 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:01.028498 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6f49c19-b1ba-4ee4-9920-1fd6bc206573 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:01.050433 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2323cc7-1ab2-4b59-9501-108a3255caaa None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:01.092733 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455b27e-f3fb-4729-bc54-8e4c69daa908 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:01.093794 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455b27e-f3fb-4729-bc54-8e4c69daa908 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:01.094260 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455b27e-f3fb-4729-bc54-8e4c69daa908 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:01.094735 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0455b27e-f3fb-4729-bc54-8e4c69daa908 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:01.109219 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455b27e-f3fb-4729-bc54-8e4c69daa908 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:01.111998 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0455b27e-f3fb-4729-bc54-8e4c69daa908 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:01.115355 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f9aa68-ba3c-4f88-9191-60e98cde70bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:01.116193 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9aa68-ba3c-4f88-9191-60e98cde70bd None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:01.116607 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9aa68-ba3c-4f88-9191-60e98cde70bd None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:01.117079 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f9aa68-ba3c-4f88-9191-60e98cde70bd None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:01.118213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9aa68-ba3c-4f88-9191-60e98cde70bd None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:01.118742 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9aa68-ba3c-4f88-9191-60e98cde70bd None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:01.121432 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f9aa68-ba3c-4f88-9191-60e98cde70bd None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:01.135291 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-0455b27e-f3fb-4729-bc54-8e4c69daa908 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:53:01.135291 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:01.135291 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:01.135291 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:01.135291 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:01.135291 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:01.135291 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:01.135291 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:01.135291 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:01.135291 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:01.135291 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:01.135291 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:01.135291 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:53:01.135291 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:53:01.135291 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:53:01.135291 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:53:01.137523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:01.137523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:01.137523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:53:01.137523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:01.137523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:53:01.137523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:01.137523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:01.137523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:01.137523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:01.137523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:01.137523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:01.137523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:01.137523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:01.137523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:01.137523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:01.137523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:01.137523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:01.137523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:01.139991 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:01.139991 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:01.139991 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:53:01.139991 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:53:01.139991 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:53:01.139991 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:53:01.139991 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:53:01.139991 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:53:01.139991 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:53:01.139991 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:01.139991 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 405/804] 10.222.0.49 () {56 vars in 1093 bytes} [Sun Aug 21 00:53:00 2022] GET /identity/v3/users/nova => generated 82 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:01.139991 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455b27e-f3fb-4729-bc54-8e4c69daa908 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:01.153793 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 400/805] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:00 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 285 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:01.156321 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c1ff4-6ffb-40ac-898c-01fed73311cd None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:01.156831 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c1ff4-6ffb-40ac-898c-01fed73311cd None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:01.157363 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d08c1ff4-6ffb-40ac-898c-01fed73311cd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:01.191053 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-d08c1ff4-6ffb-40ac-898c-01fed73311cd None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:01.193188 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d08c1ff4-6ffb-40ac-898c-01fed73311cd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:01.204142 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:01.292555 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 401/806] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:01 2022] POST /identity/v3/auth/tokens => generated 1002 bytes in 138 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:01.294058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c1ff4-6ffb-40ac-898c-01fed73311cd None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:01.298399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:01.346790 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0455b27e-f3fb-4729-bc54-8e4c69daa908 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:01.422535 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ace622-9bac-4c6c-b980-4299413878d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:01.423587 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ace622-9bac-4c6c-b980-4299413878d1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:01.424076 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ace622-9bac-4c6c-b980-4299413878d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:01.424554 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93ace622-9bac-4c6c-b980-4299413878d1 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:01.425755 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ace622-9bac-4c6c-b980-4299413878d1 None admin] RBAC: Adding query filter params (name=block-storage) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:01.426295 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ace622-9bac-4c6c-b980-4299413878d1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:01.429172 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93ace622-9bac-4c6c-b980-4299413878d1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:01.438261 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 406/807] 10.222.0.49 () {56 vars in 1124 bytes} [Sun Aug 21 00:53:01 2022] GET /identity/v3/services?name=block-storage => generated 130 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:01.439819 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ace622-9bac-4c6c-b980-4299413878d1 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:01.495647 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d08c1ff4-6ffb-40ac-898c-01fed73311cd None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:01.567370 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704cea3-35fb-4afb-abb3-bf597a9ff389 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:01.568623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704cea3-35fb-4afb-abb3-bf597a9ff389 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:01.569110 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704cea3-35fb-4afb-abb3-bf597a9ff389 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:01.569604 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9704cea3-35fb-4afb-abb3-bf597a9ff389 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:01.590807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704cea3-35fb-4afb-abb3-bf597a9ff389 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:01.593405 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9704cea3-35fb-4afb-abb3-bf597a9ff389 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:01.621812 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-9704cea3-35fb-4afb-abb3-bf597a9ff389 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:01.621812 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:01.621812 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:01.621812 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:01.621812 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:01.621812 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:01.621812 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:01.621812 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:01.621812 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:01.621812 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:01.621812 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:01.621812 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:01.621812 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:01.621812 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:01.621812 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:01.621812 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:01.623660 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:01.623660 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:01.623660 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:01.623660 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:01.623660 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:01.623660 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:01.623660 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:01.623660 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:01.623660 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:01.623660 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:01.623660 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:01.623660 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:01.623660 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:01.623660 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:01.623660 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:01.623660 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:01.623660 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:01.626788 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:01.626788 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:01.626788 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:01.626788 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 402/808] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:01 2022] GET /identity/v3/domains/Default => generated 87 bytes in 330 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:01.626788 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704cea3-35fb-4afb-abb3-bf597a9ff389 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:01.644187 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:01.661490 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93ace622-9bac-4c6c-b980-4299413878d1 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:01.741968 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521a3d0-e91f-4168-9268-8976783d2158 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:01.742780 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:01.746240 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521a3d0-e91f-4168-9268-8976783d2158 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:01.746739 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521a3d0-e91f-4168-9268-8976783d2158 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:01.747226 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5521a3d0-e91f-4168-9268-8976783d2158 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:01.748674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521a3d0-e91f-4168-9268-8976783d2158 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:01.749268 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521a3d0-e91f-4168-9268-8976783d2158 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:01.754811 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5521a3d0-e91f-4168-9268-8976783d2158 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:01.790163 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 407/809] 10.222.0.49 () {56 vars in 1133 bytes} [Sun Aug 21 00:53:01 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 351 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:01.791689 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521a3d0-e91f-4168-9268-8976783d2158 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:01.812325 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9704cea3-35fb-4afb-abb3-bf597a9ff389 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:01.868810 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876a33e-8080-412a-b0bd-3ee5dd920cc7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:01.869860 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876a33e-8080-412a-b0bd-3ee5dd920cc7 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:01.870367 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876a33e-8080-412a-b0bd-3ee5dd920cc7 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:01.870811 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7876a33e-8080-412a-b0bd-3ee5dd920cc7 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:01.881086 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876a33e-8080-412a-b0bd-3ee5dd920cc7 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:01.882646 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7876a33e-8080-412a-b0bd-3ee5dd920cc7 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:01.900866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-7876a33e-8080-412a-b0bd-3ee5dd920cc7 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:01.900866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:01.900866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:01.900866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:01.900866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:01.900866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:01.900866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:01.900866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:01.900866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:01.900866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:01.900866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:01.900866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:01.900866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:53:01.900866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:53:01.900866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:53:01.911283 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:53:01.911283 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:01.911283 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:01.911283 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:01.911283 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:01.911283 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:01.911283 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:01.911283 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:01.911283 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:01.911283 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:01.911283 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:01.911283 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:01.911283 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:01.911283 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:01.911283 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:01.911283 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:01.911283 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:01.914608 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:53:01.914608 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:53:01.914608 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:53:01.914608 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:53:01.914608 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:53:01.914608 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:53:01.914608 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:01.914608 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:01.914608 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 403/810] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:53:01 2022] GET /identity/v3/projects/service => generated 88 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:01.914608 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876a33e-8080-412a-b0bd-3ee5dd920cc7 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:01.968603 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5521a3d0-e91f-4168-9268-8976783d2158 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:02.017886 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf515b-646e-4f67-a3c8-e786391a2d29 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:02.018607 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf515b-646e-4f67-a3c8-e786391a2d29 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:02.019019 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf515b-646e-4f67-a3c8-e786391a2d29 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:02.019387 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2cf515b-646e-4f67-a3c8-e786391a2d29 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:02.020167 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf515b-646e-4f67-a3c8-e786391a2d29 None admin] RBAC: Adding query filter params (type=block-storage) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:02.020669 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf515b-646e-4f67-a3c8-e786391a2d29 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:02.022516 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a2cf515b-646e-4f67-a3c8-e786391a2d29 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:02.028919 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 408/811] 10.222.0.49 () {56 vars in 1124 bytes} [Sun Aug 21 00:53:01 2022] GET /identity/v3/services?type=block-storage => generated 367 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:02.030324 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf515b-646e-4f67-a3c8-e786391a2d29 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:02.064729 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:02.105878 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7876a33e-8080-412a-b0bd-3ee5dd920cc7 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:02.126745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:02.163004 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfdbba-1219-4f9e-a0b7-9300ea3ef98e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:02.163836 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfdbba-1219-4f9e-a0b7-9300ea3ef98e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:02.164274 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfdbba-1219-4f9e-a0b7-9300ea3ef98e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:02.164697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78bfdbba-1219-4f9e-a0b7-9300ea3ef98e None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:02.165839 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfdbba-1219-4f9e-a0b7-9300ea3ef98e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:02.166335 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfdbba-1219-4f9e-a0b7-9300ea3ef98e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:02.168690 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78bfdbba-1219-4f9e-a0b7-9300ea3ef98e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:02.190015 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 404/812] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:01 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:02.191285 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfdbba-1219-4f9e-a0b7-9300ea3ef98e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:02.209792 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2cf515b-646e-4f67-a3c8-e786391a2d29 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:02.271247 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5928da-4d25-4af5-9bc4-e0f439706bd3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:02.272365 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5928da-4d25-4af5-9bc4-e0f439706bd3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:02.272825 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5928da-4d25-4af5-9bc4-e0f439706bd3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:02.273342 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb5928da-4d25-4af5-9bc4-e0f439706bd3 None admin] PATH_INFO: `/v3/services/network` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:02.274416 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5928da-4d25-4af5-9bc4-e0f439706bd3 None admin] RBAC: Authorizing `identity:get_service(service_id=network)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:02.277703 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb5928da-4d25-4af5-9bc4-e0f439706bd3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:02.294857 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-fb5928da-4d25-4af5-9bc4-e0f439706bd3 None admin] Could not find service: network.: keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 00:53:02.294857 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:02.294857 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:53:02.294857 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:53:02.294857 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:53:02.294857 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:53:02.294857 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:53:02.294857 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:02.294857 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 00:53:02.294857 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:02.294857 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:53:02.294857 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:02.294857 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:02.294857 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:02.294857 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:02.294857 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:02.294857 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:02.296686 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:02.296686 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:02.296686 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:02.296686 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:02.296686 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:02.296686 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:02.296686 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:53:02.296686 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:53:02.296686 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:53:02.296686 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:53:02.296686 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:02.296686 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:02.296686 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:02.296686 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:02.296686 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:02.296686 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:02.298631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:02.298631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:02.298631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:02.298631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:02.298631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:02.298631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:02.298631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:02.298631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:02.298631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:02.298631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:02.298631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:53:02.298631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:02.298631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: network. Aug 21 00:53:02.298631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:02.298631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 409/813] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:53:02 2022] GET /identity/v3/services/network => generated 88 bytes in 267 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:02.300444 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5928da-4d25-4af5-9bc4-e0f439706bd3 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:02.372294 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78bfdbba-1219-4f9e-a0b7-9300ea3ef98e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:02.428322 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f439e17-b0fb-41c3-865e-f9c4dd1c9993 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:02.428322 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f439e17-b0fb-41c3-865e-f9c4dd1c9993 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:02.428322 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f439e17-b0fb-41c3-865e-f9c4dd1c9993 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:02.428322 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4f439e17-b0fb-41c3-865e-f9c4dd1c9993 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:02.440261 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:02.465775 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb5928da-4d25-4af5-9bc4-e0f439706bd3 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:02.490212 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:02.518922 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc2534-1ffe-4f46-89b9-7747c371f777 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:02.519949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc2534-1ffe-4f46-89b9-7747c371f777 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:02.520457 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc2534-1ffe-4f46-89b9-7747c371f777 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:02.521109 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51dc2534-1ffe-4f46-89b9-7747c371f777 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:02.522127 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc2534-1ffe-4f46-89b9-7747c371f777 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:02.522614 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc2534-1ffe-4f46-89b9-7747c371f777 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:02.525123 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51dc2534-1ffe-4f46-89b9-7747c371f777 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:02.533176 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f439e17-b0fb-41c3-865e-f9c4dd1c9993 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:02.535770 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4f439e17-b0fb-41c3-865e-f9c4dd1c9993 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:02.545864 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 410/814] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:53:02 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:02.547209 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc2534-1ffe-4f46-89b9-7747c371f777 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:02.675614 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51dc2534-1ffe-4f46-89b9-7747c371f777 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:02.715156 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 405/815] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:53:02 2022] GET /identity/v3/auth/tokens => generated 1002 bytes in 520 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:53:02.715156 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f439e17-b0fb-41c3-865e-f9c4dd1c9993 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:02.715460 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9c440-d78c-48d7-8d88-d9a786a00436 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:02.716029 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9c440-d78c-48d7-8d88-d9a786a00436 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:02.716307 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9c440-d78c-48d7-8d88-d9a786a00436 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:02.716607 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a9c440-d78c-48d7-8d88-d9a786a00436 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:02.717291 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9c440-d78c-48d7-8d88-d9a786a00436 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:02.718697 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a9c440-d78c-48d7-8d88-d9a786a00436 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:02.732941 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:02.749582 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 411/816] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 21 00:53:02 2022] POST /identity/v3/endpoints => generated 346 bytes in 203 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:53:02.759278 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9c440-d78c-48d7-8d88-d9a786a00436 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:02.863204 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:02.910269 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4f439e17-b0fb-41c3-865e-f9c4dd1c9993 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:02.945965 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a9c440-d78c-48d7-8d88-d9a786a00436 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:02.982539 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878c1fc-add5-4eb3-9084-a70989bd8e15 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:02.983488 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878c1fc-add5-4eb3-9084-a70989bd8e15 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:02.983972 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878c1fc-add5-4eb3-9084-a70989bd8e15 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:02.984432 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f878c1fc-add5-4eb3-9084-a70989bd8e15 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:02.998108 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878c1fc-add5-4eb3-9084-a70989bd8e15 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:03.000954 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f878c1fc-add5-4eb3-9084-a70989bd8e15 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:03.017890 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ecee1-7779-4983-8a4c-f31bf3b2ace8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:03.018906 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ecee1-7779-4983-8a4c-f31bf3b2ace8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:03.019071 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-f878c1fc-add5-4eb3-9084-a70989bd8e15 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:53:03.019071 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:03.019071 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:03.019071 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:03.019071 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:03.019071 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:03.019071 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:03.019071 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:03.019071 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:03.019071 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:03.019071 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:03.019071 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:03.019071 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:53:03.019071 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:53:03.019071 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:53:03.019071 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:53:03.025876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:03.025876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:03.025876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:53:03.025876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:03.025876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:53:03.025876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:03.025876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:03.025876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:03.025876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:03.025876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:03.025876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:03.025876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:03.025876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:03.025876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:03.025876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:03.025876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:03.025876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:03.025876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:03.027866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:03.027866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:03.027866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:53:03.027866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:53:03.027866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:53:03.027866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:53:03.027866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:53:03.027866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:53:03.027866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:53:03.027866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:03.028912 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ecee1-7779-4983-8a4c-f31bf3b2ace8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:03.028912 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e54ecee1-7779-4983-8a4c-f31bf3b2ace8 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:03.030231 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 406/817] 10.222.0.49 () {56 vars in 1117 bytes} [Sun Aug 21 00:53:02 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:03.030376 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ecee1-7779-4983-8a4c-f31bf3b2ace8 None admin] RBAC: Adding query filter params (name=network) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:03.030376 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ecee1-7779-4983-8a4c-f31bf3b2ace8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:03.030651 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878c1fc-add5-4eb3-9084-a70989bd8e15 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:03.030798 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e54ecee1-7779-4983-8a4c-f31bf3b2ace8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:03.033744 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 412/818] 10.222.0.49 () {56 vars in 1112 bytes} [Sun Aug 21 00:53:02 2022] GET /identity/v3/services?name=network => generated 124 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:03.035397 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ecee1-7779-4983-8a4c-f31bf3b2ace8 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:03.147777 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:03.230784 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f878c1fc-add5-4eb3-9084-a70989bd8e15 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:03.255479 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e54ecee1-7779-4983-8a4c-f31bf3b2ace8 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:03.296506 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935ba23-c11e-45ac-8170-c2b0021ad344 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:03.297550 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935ba23-c11e-45ac-8170-c2b0021ad344 None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:03.297987 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935ba23-c11e-45ac-8170-c2b0021ad344 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:03.298552 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5935ba23-c11e-45ac-8170-c2b0021ad344 None admin] PATH_INFO: `/v3/projects/838e996d09a0454b9bcdc5aef03ef203/users/f66a877fdca340f48f54b48e5367a194/roles/c73e9539582145ed8eedc48648b9d738` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:03.301654 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935ba23-c11e-45ac-8170-c2b0021ad344 None admin] RBAC: Authorizing `identity:create_grant(project_id=838e996d09a0454b9bcdc5aef03ef203, user_id=f66a877fdca340f48f54b48e5367a194, role_id=c73e9539582145ed8eedc48648b9d738)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:03.304255 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5935ba23-c11e-45ac-8170-c2b0021ad344 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:03.308115 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:03.323928 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6046c57-8523-48b6-a23b-ec16931c8396 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:03.324738 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6046c57-8523-48b6-a23b-ec16931c8396 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:03.325031 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6046c57-8523-48b6-a23b-ec16931c8396 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:03.325319 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f6046c57-8523-48b6-a23b-ec16931c8396 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:03.337553 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 407/819] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 21 00:53:03 2022] PUT /identity/v3/projects/838e996d09a0454b9bcdc5aef03ef203/users/f66a877fdca340f48f54b48e5367a194/roles/c73e9539582145ed8eedc48648b9d738 => generated 0 bytes in 305 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:53:03.337553 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935ba23-c11e-45ac-8170-c2b0021ad344 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:03.545036 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6046c57-8523-48b6-a23b-ec16931c8396 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:03.546912 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f6046c57-8523-48b6-a23b-ec16931c8396 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:03.562697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5935ba23-c11e-45ac-8170-c2b0021ad344 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:03.575093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-f6046c57-8523-48b6-a23b-ec16931c8396 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:03.575093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:03.575093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:03.575093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:03.575093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:03.575093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:03.575093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:03.575093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:03.575093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:03.575093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:03.575093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:03.575093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:03.575093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:03.575093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:03.575093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:03.575093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:03.577005 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:03.577005 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:03.577005 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:03.577005 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:03.577005 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:03.577005 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:03.577005 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:03.577005 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:03.577005 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:03.577005 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:03.577005 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:03.577005 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:03.577005 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:03.577005 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:03.577005 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:03.577005 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:03.577005 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:03.579323 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:03.579323 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:03.579323 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:03.579323 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 413/820] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 543 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:03.579323 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6046c57-8523-48b6-a23b-ec16931c8396 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:03.636290 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c6168-b67f-4c53-ac31-ef316125c1bd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:03.637324 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c6168-b67f-4c53-ac31-ef316125c1bd None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:03.637730 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c6168-b67f-4c53-ac31-ef316125c1bd None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:03.638169 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c17c6168-b67f-4c53-ac31-ef316125c1bd None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:03.639107 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c6168-b67f-4c53-ac31-ef316125c1bd None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:03.639552 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c6168-b67f-4c53-ac31-ef316125c1bd None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:03.641802 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c17c6168-b67f-4c53-ac31-ef316125c1bd None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:03.672675 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 408/821] 10.222.0.49 () {56 vars in 1149 bytes} [Sun Aug 21 00:53:03 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 346 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:03.674222 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c6168-b67f-4c53-ac31-ef316125c1bd None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:03.796933 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:INSERT=1,keystone:SELECT=99 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:03.823792 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f6046c57-8523-48b6-a23b-ec16931c8396 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:03.847202 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:03.894047 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d71ca2-137f-4c12-8176-9ba2a0199ec6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:03.895143 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d71ca2-137f-4c12-8176-9ba2a0199ec6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:03.895813 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d71ca2-137f-4c12-8176-9ba2a0199ec6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:03.896091 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0d71ca2-137f-4c12-8176-9ba2a0199ec6 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:03.897403 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d71ca2-137f-4c12-8176-9ba2a0199ec6 None admin] RBAC: Adding query filter params (type=network) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:03.897974 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d71ca2-137f-4c12-8176-9ba2a0199ec6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:03.900600 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f0d71ca2-137f-4c12-8176-9ba2a0199ec6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:03.910698 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c17c6168-b67f-4c53-ac31-ef316125c1bd None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:03.917515 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 414/822] 10.222.0.49 () {56 vars in 1112 bytes} [Sun Aug 21 00:53:03 2022] GET /identity/v3/services?type=network => generated 350 bytes in 333 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:03.917515 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d71ca2-137f-4c12-8176-9ba2a0199ec6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:03.994642 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cee07e-cfae-412e-a12d-1f689175ec75 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:03.995738 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cee07e-cfae-412e-a12d-1f689175ec75 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:03.996208 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cee07e-cfae-412e-a12d-1f689175ec75 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:03.996687 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2cee07e-cfae-412e-a12d-1f689175ec75 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:03.997963 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cee07e-cfae-412e-a12d-1f689175ec75 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:03.998587 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cee07e-cfae-412e-a12d-1f689175ec75 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:04.001915 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2cee07e-cfae-412e-a12d-1f689175ec75 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:04.033524 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 409/823] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:03 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 353 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:04.035226 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cee07e-cfae-412e-a12d-1f689175ec75 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:04.122586 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f0d71ca2-137f-4c12-8176-9ba2a0199ec6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:04.177565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67b90d-752c-45bd-a587-acd2a05bffd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:04.178602 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67b90d-752c-45bd-a587-acd2a05bffd5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:04.179385 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67b90d-752c-45bd-a587-acd2a05bffd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:04.179845 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca67b90d-752c-45bd-a587-acd2a05bffd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:04.200996 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67b90d-752c-45bd-a587-acd2a05bffd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:04.205193 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca67b90d-752c-45bd-a587-acd2a05bffd5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:04.220599 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2cee07e-cfae-412e-a12d-1f689175ec75 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:04.234814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ca67b90d-752c-45bd-a587-acd2a05bffd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:04.234814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:04.234814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:04.234814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:04.234814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:04.234814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:04.234814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:04.234814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:04.234814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:04.234814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:04.234814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:04.234814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:04.234814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:04.234814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:04.234814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:04.234814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:04.236473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:04.236473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:04.236473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:04.236473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:04.236473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:04.236473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:04.236473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:04.236473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:04.236473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:04.236473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:04.236473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:04.236473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:04.236473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:04.236473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:04.236473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:04.236473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:04.236473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:04.238144 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:04.238144 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:04.238144 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:04.247523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 415/824] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:03 2022] GET /identity/v3/domains/Default => generated 87 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:04.247523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67b90d-752c-45bd-a587-acd2a05bffd5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:04.263165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:04.289680 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:04.317930 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f5288-8270-44cc-bf46-a3d171c3facf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:04.319198 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f5288-8270-44cc-bf46-a3d171c3facf None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:04.319857 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f5288-8270-44cc-bf46-a3d171c3facf None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:04.320515 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df0f5288-8270-44cc-bf46-a3d171c3facf None admin] PATH_INFO: `/v3/endpoints` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:04.321871 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f5288-8270-44cc-bf46-a3d171c3facf None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:04.325940 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df0f5288-8270-44cc-bf46-a3d171c3facf None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:04.373974 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 410/825] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 21 00:53:04 2022] POST /identity/v3/endpoints => generated 337 bytes in 334 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:53:04.376368 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f5288-8270-44cc-bf46-a3d171c3facf None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:04.471031 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca67b90d-752c-45bd-a587-acd2a05bffd5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:04.610411 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f61c76-5d2f-4cfd-8349-cc94b34bc974 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:04.611780 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f61c76-5d2f-4cfd-8349-cc94b34bc974 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:04.612260 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f61c76-5d2f-4cfd-8349-cc94b34bc974 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:04.612729 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0f61c76-5d2f-4cfd-8349-cc94b34bc974 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:04.634134 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f61c76-5d2f-4cfd-8349-cc94b34bc974 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:04.636662 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0f61c76-5d2f-4cfd-8349-cc94b34bc974 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:04.656723 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-e0f61c76-5d2f-4cfd-8349-cc94b34bc974 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:04.656723 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:04.656723 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:04.656723 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:04.656723 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:04.656723 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:04.656723 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:04.656723 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:04.656723 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:04.656723 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:04.656723 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:04.656723 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:04.656723 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:53:04.656723 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:53:04.656723 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:53:04.658564 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:53:04.658564 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:04.658564 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:04.658564 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:04.658564 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:04.658564 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:04.658564 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:04.658564 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:04.658564 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:04.658564 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:04.658564 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:04.658564 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:04.658564 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:04.658564 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:04.658564 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:04.658564 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:04.658564 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:04.660332 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:53:04.660332 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:53:04.660332 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:53:04.660332 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:53:04.660332 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:53:04.660332 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:53:04.660332 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:04.660332 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:04.660332 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 416/826] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:53:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 417 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:04.669852 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f61c76-5d2f-4cfd-8349-cc94b34bc974 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:04.711724 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df0f5288-8270-44cc-bf46-a3d171c3facf None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:04.802343 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd27d2-2891-4384-b60a-aa7e6c34bbbb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:04.803971 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd27d2-2891-4384-b60a-aa7e6c34bbbb None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:04.804460 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd27d2-2891-4384-b60a-aa7e6c34bbbb None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:04.805112 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9dd27d2-2891-4384-b60a-aa7e6c34bbbb None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:04.806528 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd27d2-2891-4384-b60a-aa7e6c34bbbb None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:04.807038 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd27d2-2891-4384-b60a-aa7e6c34bbbb None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:04.809825 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9dd27d2-2891-4384-b60a-aa7e6c34bbbb None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:04.831489 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:04.841500 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 411/827] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:04 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 466 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:04.857560 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd27d2-2891-4384-b60a-aa7e6c34bbbb None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:04.891003 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0f61c76-5d2f-4cfd-8349-cc94b34bc974 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:04.932129 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:04.958962 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea123ca5-cccf-46e4-b291-80ec15464cc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:04.960631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea123ca5-cccf-46e4-b291-80ec15464cc2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:04.961489 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea123ca5-cccf-46e4-b291-80ec15464cc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:04.962264 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea123ca5-cccf-46e4-b291-80ec15464cc2 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:04.969090 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea123ca5-cccf-46e4-b291-80ec15464cc2 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:04.969777 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea123ca5-cccf-46e4-b291-80ec15464cc2 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:04.977464 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea123ca5-cccf-46e4-b291-80ec15464cc2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:05.007574 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 417/828] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:53:04 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 343 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:05.017720 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea123ca5-cccf-46e4-b291-80ec15464cc2 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:05.110847 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9dd27d2-2891-4384-b60a-aa7e6c34bbbb None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:05.193013 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9dc46-82e5-495f-90eb-5110da43cac8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:05.194061 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9dc46-82e5-495f-90eb-5110da43cac8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:05.194526 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9dc46-82e5-495f-90eb-5110da43cac8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:05.195624 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e6d9dc46-82e5-495f-90eb-5110da43cac8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:05.217634 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9dc46-82e5-495f-90eb-5110da43cac8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:05.220646 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e6d9dc46-82e5-495f-90eb-5110da43cac8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:05.242213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-e6d9dc46-82e5-495f-90eb-5110da43cac8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:05.242213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:05.242213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:05.242213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:05.242213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:05.242213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:05.242213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:05.242213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:05.242213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:05.242213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:05.242213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:05.242213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:05.242213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:53:05.242213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:53:05.242213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:53:05.244309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:53:05.244309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:05.244309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:05.244309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:05.244309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:05.244309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:05.244309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:05.244309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:05.244309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:05.244309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:05.244309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:05.244309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:05.244309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:05.244309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:05.244309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:05.244309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:05.244309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:05.246545 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:53:05.246545 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:53:05.246545 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:53:05.246545 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:53:05.246545 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:53:05.246545 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:53:05.246545 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:05.246545 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:05.253775 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 412/829] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:53:04 2022] GET /identity/v3/projects/service => generated 88 bytes in 397 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:05.255240 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea123ca5-cccf-46e4-b291-80ec15464cc2 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:05.256651 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9dc46-82e5-495f-90eb-5110da43cac8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:05.326019 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e1b55-bca1-4cdc-ba08-7982e068791c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:05.327120 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e1b55-bca1-4cdc-ba08-7982e068791c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:05.327615 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e1b55-bca1-4cdc-ba08-7982e068791c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:05.328107 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b56e1b55-bca1-4cdc-ba08-7982e068791c None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:05.330366 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e1b55-bca1-4cdc-ba08-7982e068791c None admin] RBAC: Adding query filter params (role.id=c73e9539582145ed8eedc48648b9d738, scope.project.id=838e996d09a0454b9bcdc5aef03ef203, user.id=6b003ae4a082485ab608bf84c1657159) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:05.330978 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e1b55-bca1-4cdc-ba08-7982e068791c None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:05.333525 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b56e1b55-bca1-4cdc-ba08-7982e068791c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:05.351719 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 418/830] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:53:05 2022] GET /identity/v3/role_assignments?user.id=6b003ae4a082485ab608bf84c1657159&scope.project.id=838e996d09a0454b9bcdc5aef03ef203&role.id=c73e9539582145ed8eedc48648b9d738 => generated 608 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:05.446359 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:05.454265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e6d9dc46-82e5-495f-90eb-5110da43cac8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:05.523383 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8eaf76f-37ef-48a2-9273-bd34f6a6c7da None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:05.524293 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaf76f-37ef-48a2-9273-bd34f6a6c7da None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:05.524694 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaf76f-37ef-48a2-9273-bd34f6a6c7da None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:05.525126 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8eaf76f-37ef-48a2-9273-bd34f6a6c7da None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:05.526642 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eaf76f-37ef-48a2-9273-bd34f6a6c7da None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:05.527140 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eaf76f-37ef-48a2-9273-bd34f6a6c7da None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:05.529706 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8eaf76f-37ef-48a2-9273-bd34f6a6c7da None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:05.553192 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 413/831] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:53:05 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:05.563107 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e1b55-bca1-4cdc-ba08-7982e068791c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:05.571219 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:05.753030 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b56e1b55-bca1-4cdc-ba08-7982e068791c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:05.822120 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-299d77de-1e08-4047-8fbe-48f39d12d26f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:05.823309 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d77de-1e08-4047-8fbe-48f39d12d26f None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:05.823745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d77de-1e08-4047-8fbe-48f39d12d26f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:05.824195 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-299d77de-1e08-4047-8fbe-48f39d12d26f None admin] PATH_INFO: `/v3/projects/838e996d09a0454b9bcdc5aef03ef203/users/a06f043017114f9090264293f5ede6c4/roles/b549ba322af24099825f8949d2060adf` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:05.853994 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d77de-1e08-4047-8fbe-48f39d12d26f None admin] RBAC: Authorizing `identity:create_grant(project_id=838e996d09a0454b9bcdc5aef03ef203, user_id=a06f043017114f9090264293f5ede6c4, role_id=b549ba322af24099825f8949d2060adf)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:05.857384 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-299d77de-1e08-4047-8fbe-48f39d12d26f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:05.885499 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 419/832] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 21 00:53:05 2022] PUT /identity/v3/projects/838e996d09a0454b9bcdc5aef03ef203/users/a06f043017114f9090264293f5ede6c4/roles/b549ba322af24099825f8949d2060adf => generated 0 bytes in 323 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:53:06.164030 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65936ca3-1046-4e2b-9bd5-ed2ac047e3ee None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:06.164516 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65936ca3-1046-4e2b-9bd5-ed2ac047e3ee None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:06.164892 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65936ca3-1046-4e2b-9bd5-ed2ac047e3ee None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:06.167740 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 414/833] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:06.178102 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb232773-0dcb-459b-91e1-b3aac20481f8 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:06.178593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb232773-0dcb-459b-91e1-b3aac20481f8 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:06.179076 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb232773-0dcb-459b-91e1-b3aac20481f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:06.211547 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-cb232773-0dcb-459b-91e1-b3aac20481f8 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:06.217105 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-cb232773-0dcb-459b-91e1-b3aac20481f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:06.318376 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:06.353002 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 420/834] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 177 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:06.665692 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d030541-ebbf-4e6a-be72-7d7fdf615acb None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:06.666540 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d030541-ebbf-4e6a-be72-7d7fdf615acb None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:06.666681 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d030541-ebbf-4e6a-be72-7d7fdf615acb None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:06.669816 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 415/835] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:06 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:06.679226 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90a50c-c36b-4c2d-a937-6cda87089d5f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:06.679681 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90a50c-c36b-4c2d-a937-6cda87089d5f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:06.680140 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d90a50c-c36b-4c2d-a937-6cda87089d5f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:06.712201 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-7d90a50c-c36b-4c2d-a937-6cda87089d5f None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:06.714492 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7d90a50c-c36b-4c2d-a937-6cda87089d5f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:06.856205 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 421/836] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:06 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:53:06.862771 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d030541-ebbf-4e6a-be72-7d7fdf615acb None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:07.084930 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d030541-ebbf-4e6a-be72-7d7fdf615acb None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:07.155626 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afee8d9-dc10-427d-8926-f38e9e9e225d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:07.156661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afee8d9-dc10-427d-8926-f38e9e9e225d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:07.157154 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afee8d9-dc10-427d-8926-f38e9e9e225d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:07.157623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1afee8d9-dc10-427d-8926-f38e9e9e225d None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:07.158687 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afee8d9-dc10-427d-8926-f38e9e9e225d None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:07.161460 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1afee8d9-dc10-427d-8926-f38e9e9e225d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:07.176914 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-1afee8d9-dc10-427d-8926-f38e9e9e225d None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 00:53:07.176914 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:07.176914 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:53:07.176914 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:53:07.176914 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:53:07.176914 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:53:07.176914 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:53:07.176914 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:07.176914 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 00:53:07.176914 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:07.176914 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:53:07.176914 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:07.176914 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:07.176914 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:07.176914 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:07.176914 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:07.176914 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:07.178893 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:07.178893 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:07.178893 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:07.178893 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:07.178893 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:07.178893 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:07.178893 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:53:07.178893 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:53:07.178893 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:53:07.178893 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:53:07.178893 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:07.178893 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:07.178893 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:07.178893 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:07.178893 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:07.178893 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:07.180344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:07.180344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:07.180344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:07.180344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:07.180344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:07.180344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:07.180344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:07.180344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:07.180344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:07.180344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:07.180344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:53:07.180344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:07.180344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 00:53:07.180344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:07.180344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 416/837] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 21 00:53:06 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 318 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:07.192960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90a50c-c36b-4c2d-a937-6cda87089d5f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:07.374812 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afee8d9-dc10-427d-8926-f38e9e9e225d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:07.403227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d90a50c-c36b-4c2d-a937-6cda87089d5f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:07.405371 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:07.436679 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:07.474203 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f7a96-3660-4758-a47f-ffea06d2792d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:07.475567 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f7a96-3660-4758-a47f-ffea06d2792d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:07.476229 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f7a96-3660-4758-a47f-ffea06d2792d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:07.476853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-160f7a96-3660-4758-a47f-ffea06d2792d None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:07.478281 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f7a96-3660-4758-a47f-ffea06d2792d None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:07.478975 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f7a96-3660-4758-a47f-ffea06d2792d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:07.481610 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-160f7a96-3660-4758-a47f-ffea06d2792d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:07.490669 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 422/838] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 21 00:53:07 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 299 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:07.501134 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f7a96-3660-4758-a47f-ffea06d2792d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:07.592302 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1afee8d9-dc10-427d-8926-f38e9e9e225d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:07.662636 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebcde43-223d-42fc-9413-c3d1969f76ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:07.663520 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcde43-223d-42fc-9413-c3d1969f76ee None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:07.663949 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcde43-223d-42fc-9413-c3d1969f76ee None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:07.664361 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4ebcde43-223d-42fc-9413-c3d1969f76ee None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:07.685218 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4ebcde43-223d-42fc-9413-c3d1969f76ee None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:53:07.695026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-4ebcde43-223d-42fc-9413-c3d1969f76ee None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:53:07.695026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:07.695026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:07.695026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:07.695026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:07.695026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:07.695026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:07.695026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:07.695026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:07.695026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:07.695026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:07.695026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:07.695026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:53:07.695026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:53:07.695026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:53:07.695026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:53:07.696888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:53:07.696888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:53:07.696888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:53:07.696888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:53:07.696888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:07.696888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:07.696888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:07.696888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:07.696888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:07.696888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:07.696888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:07.696888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:07.696888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:07.696888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:07.696888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:07.696888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:07.698695 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:07.698695 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:07.698695 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:07.698695 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:07.698695 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:53:07.698695 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:53:07.698695 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:53:07.698695 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:53:07.698695 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:53:07.698695 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:53:07.698695 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:53:07.698695 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:07.698695 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 417/839] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:53:07 2022] GET /identity/v3/roles/admin => generated 83 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:53:07.708088 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebcde43-223d-42fc-9413-c3d1969f76ee None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:07.713140 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-160f7a96-3660-4758-a47f-ffea06d2792d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:07.782189 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b2aa7-6582-4714-b410-60aa4242faa2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:07.784275 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b2aa7-6582-4714-b410-60aa4242faa2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:07.784275 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b2aa7-6582-4714-b410-60aa4242faa2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:07.784275 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ad2b2aa7-6582-4714-b410-60aa4242faa2 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:07.789083 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b2aa7-6582-4714-b410-60aa4242faa2 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:07.789083 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b2aa7-6582-4714-b410-60aa4242faa2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:07.789083 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ad2b2aa7-6582-4714-b410-60aa4242faa2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:07.797705 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 423/840] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 21 00:53:07 2022] GET /identity/v3/services?type=volumev3 => generated 125 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:07.866884 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:07.937484 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4ebcde43-223d-42fc-9413-c3d1969f76ee None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:08.012153 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23d098-97ab-4a8f-9446-f75455bd2c5c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:08.013413 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23d098-97ab-4a8f-9446-f75455bd2c5c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:08.013936 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23d098-97ab-4a8f-9446-f75455bd2c5c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:08.014420 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d23d098-97ab-4a8f-9446-f75455bd2c5c None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:08.016764 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23d098-97ab-4a8f-9446-f75455bd2c5c None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:08.016764 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23d098-97ab-4a8f-9446-f75455bd2c5c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:08.019090 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d23d098-97ab-4a8f-9446-f75455bd2c5c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:08.037934 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 418/841] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:53:07 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 331 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:08.048532 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b2aa7-6582-4714-b410-60aa4242faa2 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:08.130293 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:08.243950 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ad2b2aa7-6582-4714-b410-60aa4242faa2 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:08.304188 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737feeb-a4e6-4879-8d7d-e742dd77d5d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:08.305882 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737feeb-a4e6-4879-8d7d-e742dd77d5d5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:08.306633 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737feeb-a4e6-4879-8d7d-e742dd77d5d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:08.307360 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0737feeb-a4e6-4879-8d7d-e742dd77d5d5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:08.327704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737feeb-a4e6-4879-8d7d-e742dd77d5d5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:08.330802 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0737feeb-a4e6-4879-8d7d-e742dd77d5d5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:08.356452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-0737feeb-a4e6-4879-8d7d-e742dd77d5d5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:08.356452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:08.356452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:08.356452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:08.356452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:08.356452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:08.356452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:08.356452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:08.356452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:08.356452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:08.356452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:08.356452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:08.356452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:08.356452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:08.356452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:08.356452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:08.358300 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:08.358300 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:08.358300 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:08.358300 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:08.358300 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:08.358300 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:08.358300 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:08.358300 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:08.358300 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:08.358300 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:08.358300 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:08.358300 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:08.358300 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:08.358300 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:08.358300 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:08.358300 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:08.358300 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:08.360010 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:08.360010 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:08.360010 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:08.363629 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 424/842] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:08 2022] GET /identity/v3/domains/Default => generated 87 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:08.373663 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23d098-97ab-4a8f-9446-f75455bd2c5c None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:08.586483 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d23d098-97ab-4a8f-9446-f75455bd2c5c None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:08.651185 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf4d786-151d-46e3-a939-9594f2058427 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:08.652692 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4d786-151d-46e3-a939-9594f2058427 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:08.653329 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4d786-151d-46e3-a939-9594f2058427 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:08.653933 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf4d786-151d-46e3-a939-9594f2058427 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:08.654878 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4d786-151d-46e3-a939-9594f2058427 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:08.655390 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4d786-151d-46e3-a939-9594f2058427 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:08.657106 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf4d786-151d-46e3-a939-9594f2058427 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:08.659369 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:08.675681 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 419/843] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:08 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:08.686084 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737feeb-a4e6-4879-8d7d-e742dd77d5d5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:08.795323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41be6f9-dcb9-4615-a855-150e456211e0 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:08.796143 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41be6f9-dcb9-4615-a855-150e456211e0 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:08.796276 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d41be6f9-dcb9-4615-a855-150e456211e0 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:08.801592 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 420/844] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:08 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:53:08.808691 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803482b4-0234-4f10-9e51-91db9bf5fdb1 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:08.809175 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803482b4-0234-4f10-9e51-91db9bf5fdb1 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:08.809632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-803482b4-0234-4f10-9e51-91db9bf5fdb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:08.843114 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-803482b4-0234-4f10-9e51-91db9bf5fdb1 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:08.845149 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-803482b4-0234-4f10-9e51-91db9bf5fdb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:08.877633 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:08.888358 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0737feeb-a4e6-4879-8d7d-e742dd77d5d5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:08.959127 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989dd9a6-32e9-4ad1-bf36-d3d0230b8a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:08.961383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dd9a6-32e9-4ad1-bf36-d3d0230b8a91 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:08.962240 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dd9a6-32e9-4ad1-bf36-d3d0230b8a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:08.963002 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-989dd9a6-32e9-4ad1-bf36-d3d0230b8a91 None admin] PATH_INFO: `/v3/users/swift` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:08.979761 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989dd9a6-32e9-4ad1-bf36-d3d0230b8a91 None admin] RBAC: Authorizing `identity:get_user(user_id=swift)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:08.980257 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 421/845] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:08 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:08.983510 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-989dd9a6-32e9-4ad1-bf36-d3d0230b8a91 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:09.008095 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-989dd9a6-32e9-4ad1-bf36-d3d0230b8a91 None admin] Could not find user: swift.: keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:53:09.008095 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:09.008095 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:09.008095 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:09.008095 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:09.008095 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:09.008095 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:09.008095 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:09.008095 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:09.008095 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:09.008095 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:09.008095 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:09.008095 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:53:09.008095 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:53:09.008095 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:53:09.008095 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:53:09.010067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:09.010067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:09.010067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:53:09.010067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:09.010067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:53:09.010067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:09.010067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:09.010067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:09.010067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:09.010067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:09.010067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:09.010067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:09.010067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:09.010067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:09.010067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:09.010067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:09.010067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:09.010067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:09.012721 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:09.012721 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:09.012721 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:53:09.012721 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:53:09.012721 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:53:09.012721 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:53:09.012721 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:53:09.012721 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:53:09.012721 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: swift. Aug 21 00:53:09.012721 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:09.016858 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 425/846] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:53:08 2022] GET /identity/v3/users/swift => generated 83 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:09.026295 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803482b4-0234-4f10-9e51-91db9bf5fdb1 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:09.229196 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-803482b4-0234-4f10-9e51-91db9bf5fdb1 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:09.279507 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:09.287998 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b84279f7-5f96-4db0-ab44-cff93c730a42 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:09.288651 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84279f7-5f96-4db0-ab44-cff93c730a42 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:09.289099 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84279f7-5f96-4db0-ab44-cff93c730a42 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:09.289387 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b84279f7-5f96-4db0-ab44-cff93c730a42 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:09.290158 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84279f7-5f96-4db0-ab44-cff93c730a42 None admin] RBAC: Adding query filter params (domain_id=default, name=swift) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:09.290495 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84279f7-5f96-4db0-ab44-cff93c730a42 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:09.292781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b84279f7-5f96-4db0-ab44-cff93c730a42 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:09.313424 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 422/847] 10.222.0.49 () {56 vars in 1135 bytes} [Sun Aug 21 00:53:09 2022] GET /identity/v3/users?domain_id=default&name=swift => generated 370 bytes in 288 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:09.319380 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989dd9a6-32e9-4ad1-bf36-d3d0230b8a91 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:09.381418 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279f1fc-ebd3-40ae-9b84-7caeb944e5f1 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:09.381844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279f1fc-ebd3-40ae-9b84-7caeb944e5f1 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:09.382264 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3279f1fc-ebd3-40ae-9b84-7caeb944e5f1 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:09.384986 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 423/848] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:09 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:53:09.391341 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafec2d-1453-45ab-a98a-37f74fcd8639 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:09.391732 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafec2d-1453-45ab-a98a-37f74fcd8639 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:09.391958 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6bafec2d-1453-45ab-a98a-37f74fcd8639 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:09.411966 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-6bafec2d-1453-45ab-a98a-37f74fcd8639 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:09.413330 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-6bafec2d-1453-45ab-a98a-37f74fcd8639 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:09.474903 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-989dd9a6-32e9-4ad1-bf36-d3d0230b8a91 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:09.501499 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 424/849] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:09 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 111 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:09.544712 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f708a-2f29-4919-b075-20236f9050fc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:09.545269 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafec2d-1453-45ab-a98a-37f74fcd8639 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:09.545822 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f708a-2f29-4919-b075-20236f9050fc None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:09.546395 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f708a-2f29-4919-b075-20236f9050fc None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:09.546888 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f8f708a-2f29-4919-b075-20236f9050fc None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:09.596162 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:09.685342 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f708a-2f29-4919-b075-20236f9050fc None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:09.688379 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2f8f708a-2f29-4919-b075-20236f9050fc None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:09.758309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6bafec2d-1453-45ab-a98a-37f74fcd8639 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:09.790699 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:09.852742 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc5498-16c3-4d5e-92ab-6ebf65f499e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:09.855238 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc5498-16c3-4d5e-92ab-6ebf65f499e8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:09.856029 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc5498-16c3-4d5e-92ab-6ebf65f499e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:09.856751 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bc5498-16c3-4d5e-92ab-6ebf65f499e8 None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:09.858109 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc5498-16c3-4d5e-92ab-6ebf65f499e8 None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:09.860896 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bc5498-16c3-4d5e-92ab-6ebf65f499e8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:09.879069 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-64bc5498-16c3-4d5e-92ab-6ebf65f499e8 None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 00:53:09.879069 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:09.879069 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:53:09.879069 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:53:09.879069 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:53:09.879069 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:53:09.879069 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:53:09.879069 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:09.879069 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 00:53:09.879069 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:09.879069 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:53:09.879069 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:09.879069 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:09.879069 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:09.879069 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:09.879069 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:09.880809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:09.880809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:09.880809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:09.880809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:09.880809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:09.880809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:09.880809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:09.880809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:53:09.880809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:53:09.880809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:53:09.880809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:53:09.880809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:09.880809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:09.880809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:09.880809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:09.880809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:09.880809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:09.882497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:09.882497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:09.882497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:09.882497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:09.882497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:09.882497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:09.882497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:09.882497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:09.882497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:09.882497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:09.882497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:53:09.882497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:09.882497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 00:53:09.882497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:09.893519 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 425/850] 10.222.0.49 () {56 vars in 1132 bytes} [Sun Aug 21 00:53:09 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 349 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:53:09.897622 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc5498-16c3-4d5e-92ab-6ebf65f499e8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:09.918390 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 426/851] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:53:09 2022] GET /identity/v3/auth/tokens => generated 1161 bytes in 599 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:53:09.930831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f708a-2f29-4919-b075-20236f9050fc None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:10.039782 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:10.094174 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bc5498-16c3-4d5e-92ab-6ebf65f499e8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:10.128789 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f8f708a-2f29-4919-b075-20236f9050fc None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:10.160280 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df86ec3-7df6-4574-b01c-4a3d15db56c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:10.161097 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df86ec3-7df6-4574-b01c-4a3d15db56c8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:10.161371 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df86ec3-7df6-4574-b01c-4a3d15db56c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:10.161781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6df86ec3-7df6-4574-b01c-4a3d15db56c8 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:10.162918 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df86ec3-7df6-4574-b01c-4a3d15db56c8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:10.163431 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df86ec3-7df6-4574-b01c-4a3d15db56c8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:10.165975 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6df86ec3-7df6-4574-b01c-4a3d15db56c8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:10.175023 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 426/852] 10.222.0.49 () {56 vars in 1126 bytes} [Sun Aug 21 00:53:09 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:10.176386 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df86ec3-7df6-4574-b01c-4a3d15db56c8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:10.209131 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86759f-182d-4d7b-8ebf-b1e3ec1eb452 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:10.210229 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86759f-182d-4d7b-8ebf-b1e3ec1eb452 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:10.210705 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86759f-182d-4d7b-8ebf-b1e3ec1eb452 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:10.211247 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b86759f-182d-4d7b-8ebf-b1e3ec1eb452 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:10.239276 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b86759f-182d-4d7b-8ebf-b1e3ec1eb452 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:10.242562 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b86759f-182d-4d7b-8ebf-b1e3ec1eb452 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:10.270940 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:10.273685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-1b86759f-182d-4d7b-8ebf-b1e3ec1eb452 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:10.273685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:10.273685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:10.273685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:10.273685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:10.273685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:10.273685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:10.273685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:10.273685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:10.273685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:10.273685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:10.273685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:10.273685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:10.273685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:10.273685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:10.273685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:10.275503 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:10.275503 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:10.275503 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:10.275503 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:10.275503 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:10.275503 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:10.275503 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:10.275503 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:10.275503 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:10.275503 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:10.275503 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:10.275503 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:10.275503 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:10.275503 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:10.275503 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:10.275503 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:10.275503 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:10.276707 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:10.276707 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:10.276707 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:10.276707 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 427/853] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:09 2022] GET /identity/v3/domains/Default => generated 87 bytes in 347 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:10.278363 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86759f-182d-4d7b-8ebf-b1e3ec1eb452 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:10.380083 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6df86ec3-7df6-4574-b01c-4a3d15db56c8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:10.442768 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f2d4b-ed1b-436d-ae3a-78525365e201 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:10.443825 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f2d4b-ed1b-436d-ae3a-78525365e201 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:10.444315 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f2d4b-ed1b-436d-ae3a-78525365e201 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:10.444786 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a0f2d4b-ed1b-436d-ae3a-78525365e201 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:10.445458 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b86759f-182d-4d7b-8ebf-b1e3ec1eb452 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:10.458719 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:10.464920 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a0f2d4b-ed1b-436d-ae3a-78525365e201 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:53:10.473909 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-0a0f2d4b-ed1b-436d-ae3a-78525365e201 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:53:10.473909 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:10.473909 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:10.473909 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:10.473909 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:10.473909 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:10.473909 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:10.473909 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:10.473909 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:10.473909 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:10.473909 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:10.473909 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:10.473909 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:53:10.473909 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:53:10.473909 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:53:10.473909 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:53:10.475809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:53:10.475809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:53:10.475809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:53:10.475809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:53:10.475809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:10.475809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:10.475809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:10.475809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:10.475809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:10.475809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:10.475809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:10.475809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:10.475809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:10.475809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:10.475809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:10.475809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:10.477486 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:10.477486 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:10.477486 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:10.477486 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:10.477486 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:53:10.477486 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:53:10.477486 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:53:10.477486 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:53:10.477486 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:53:10.477486 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:53:10.477486 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:53:10.477486 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:10.483526 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 427/854] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 21 00:53:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:10.484786 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f2d4b-ed1b-436d-ae3a-78525365e201 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:10.526573 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb53171-6bdd-4124-8b9e-25cb6dc4c508 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:10.529296 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb53171-6bdd-4124-8b9e-25cb6dc4c508 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:10.529775 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb53171-6bdd-4124-8b9e-25cb6dc4c508 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:10.534327 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9cb53171-6bdd-4124-8b9e-25cb6dc4c508 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:10.535679 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb53171-6bdd-4124-8b9e-25cb6dc4c508 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:10.536148 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb53171-6bdd-4124-8b9e-25cb6dc4c508 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:10.539370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9cb53171-6bdd-4124-8b9e-25cb6dc4c508 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:10.547988 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 428/855] 10.222.0.49 () {56 vars in 1126 bytes} [Sun Aug 21 00:53:10 2022] GET /identity/v3/services?type=compute_legacy => generated 131 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:10.549523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb53171-6bdd-4124-8b9e-25cb6dc4c508 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:10.714426 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:10.720593 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a0f2d4b-ed1b-436d-ae3a-78525365e201 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:10.736540 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9cb53171-6bdd-4124-8b9e-25cb6dc4c508 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:10.792791 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb01cd7-8751-40bc-a694-2c0d25813300 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:10.794144 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb01cd7-8751-40bc-a694-2c0d25813300 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:10.794634 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb01cd7-8751-40bc-a694-2c0d25813300 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:10.795115 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1eb01cd7-8751-40bc-a694-2c0d25813300 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:10.796326 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb01cd7-8751-40bc-a694-2c0d25813300 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:10.797894 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb01cd7-8751-40bc-a694-2c0d25813300 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:10.800523 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1eb01cd7-8751-40bc-a694-2c0d25813300 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:10.810359 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dfce6-6637-4d8b-9e15-0f992a4fb233 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:10.811434 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dfce6-6637-4d8b-9e15-0f992a4fb233 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:10.811886 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dfce6-6637-4d8b-9e15-0f992a4fb233 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:10.812366 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e5dfce6-6637-4d8b-9e15-0f992a4fb233 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:10.813801 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dfce6-6637-4d8b-9e15-0f992a4fb233 None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:10.814356 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dfce6-6637-4d8b-9e15-0f992a4fb233 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:10.817135 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e5dfce6-6637-4d8b-9e15-0f992a4fb233 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:10.819812 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 428/856] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:10 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 336 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:10.826869 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb01cd7-8751-40bc-a694-2c0d25813300 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:10.830664 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 429/857] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 21 00:53:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:10.837288 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dfce6-6637-4d8b-9e15-0f992a4fb233 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:10.891917 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:10.998578 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1eb01cd7-8751-40bc-a694-2c0d25813300 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:11.004899 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e5dfce6-6637-4d8b-9e15-0f992a4fb233 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:11.049312 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-659d790d-3d2b-41f6-8e2f-6e5001486f89 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:11.050227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d790d-3d2b-41f6-8e2f-6e5001486f89 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:11.050481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8fb0238a-a4fa-41cb-85e7-20dc1fa9716e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:11.050671 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d790d-3d2b-41f6-8e2f-6e5001486f89 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:11.051074 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-659d790d-3d2b-41f6-8e2f-6e5001486f89 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:11.051238 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0238a-a4fa-41cb-85e7-20dc1fa9716e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:11.051482 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0238a-a4fa-41cb-85e7-20dc1fa9716e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:11.051777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fb0238a-a4fa-41cb-85e7-20dc1fa9716e None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:11.061111 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0238a-a4fa-41cb-85e7-20dc1fa9716e None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:11.062665 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8fb0238a-a4fa-41cb-85e7-20dc1fa9716e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:11.065676 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d790d-3d2b-41f6-8e2f-6e5001486f89 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:11.067460 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-659d790d-3d2b-41f6-8e2f-6e5001486f89 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:11.076368 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-8fb0238a-a4fa-41cb-85e7-20dc1fa9716e None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:11.076368 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:11.076368 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:11.076368 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:11.076368 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:11.076368 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:11.076368 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:11.076368 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:11.076368 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:11.076368 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:11.076368 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:11.076368 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:11.076368 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:53:11.076368 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:53:11.076368 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:53:11.078313 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:53:11.078313 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:11.078313 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:11.078313 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:11.078313 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:11.078313 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:11.078313 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:11.078313 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:11.078313 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:11.078313 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:11.078313 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:11.078313 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:11.078313 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:11.078313 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:11.078313 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:11.078313 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:11.078313 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:11.079455 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:53:11.079455 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:53:11.079455 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:53:11.079455 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:53:11.079455 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:53:11.079455 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:53:11.079455 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:11.079455 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:11.081588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 429/858] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:53:10 2022] GET /identity/v3/projects/service => generated 88 bytes in 256 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:11.084611 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78f62d-5e59-4bbc-aa88-1be2ceea8642 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:11.085077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78f62d-5e59-4bbc-aa88-1be2ceea8642 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:11.085537 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c78f62d-5e59-4bbc-aa88-1be2ceea8642 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:11.088144 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 430/859] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:11 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:11.092713 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78f62d-5e59-4bbc-aa88-1be2ceea8642 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:11.092892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-659d790d-3d2b-41f6-8e2f-6e5001486f89 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:11.092892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:11.092892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:11.092892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:11.092892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:11.092892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:11.092892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:11.092892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:11.092892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:11.092892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:11.092892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:11.092892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:11.092892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:11.092892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:11.092892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:11.092892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:11.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:11.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:11.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:11.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:11.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:11.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:11.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:11.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:11.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:11.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:11.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:11.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:11.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:11.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:11.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:11.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:11.093949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:11.094967 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:11.094967 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:11.094967 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:11.101557 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 430/860] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:10 2022] GET /identity/v3/domains/Default => generated 87 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:11.103483 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10241902-b98e-4885-bfc4-ca1b5e5487a1 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:11.103913 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10241902-b98e-4885-bfc4-ca1b5e5487a1 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:11.104337 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10241902-b98e-4885-bfc4-ca1b5e5487a1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:11.132113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:11.134248 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-10241902-b98e-4885-bfc4-ca1b5e5487a1 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:11.136183 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-10241902-b98e-4885-bfc4-ca1b5e5487a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:11.248306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 431/861] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:11 2022] POST /identity/v3/auth/tokens => generated 1161 bytes in 146 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:11.250546 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10241902-b98e-4885-bfc4-ca1b5e5487a1 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:11.266787 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c78f62d-5e59-4bbc-aa88-1be2ceea8642 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:11.280369 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:11.314845 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb765fa6-2e64-406a-bc69-16bbd76a9eab None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:11.316354 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb765fa6-2e64-406a-bc69-16bbd76a9eab None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:11.317615 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb765fa6-2e64-406a-bc69-16bbd76a9eab None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:11.318035 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb765fa6-2e64-406a-bc69-16bbd76a9eab None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:11.322033 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb765fa6-2e64-406a-bc69-16bbd76a9eab None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:11.322679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb765fa6-2e64-406a-bc69-16bbd76a9eab None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:11.324623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb765fa6-2e64-406a-bc69-16bbd76a9eab None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:11.344072 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 431/862] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:53:11 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 255 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:11.352973 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb765fa6-2e64-406a-bc69-16bbd76a9eab None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:11.444060 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10241902-b98e-4885-bfc4-ca1b5e5487a1 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:11.525591 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a387c-3584-41ca-909c-dcd6a9afed1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:11.528255 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a387c-3584-41ca-909c-dcd6a9afed1b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:11.529185 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a387c-3584-41ca-909c-dcd6a9afed1b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:11.529915 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e16a387c-3584-41ca-909c-dcd6a9afed1b None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:11.531984 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:11.532574 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a387c-3584-41ca-909c-dcd6a9afed1b None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:11.533404 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a387c-3584-41ca-909c-dcd6a9afed1b None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:11.539337 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e16a387c-3584-41ca-909c-dcd6a9afed1b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:11.566004 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 432/863] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:11.567943 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a387c-3584-41ca-909c-dcd6a9afed1b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:11.572432 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb765fa6-2e64-406a-bc69-16bbd76a9eab None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:11.635560 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8afa9-5e6f-46ea-abd9-692bbfb3f958 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:11.637119 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8afa9-5e6f-46ea-abd9-692bbfb3f958 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:11.637890 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8afa9-5e6f-46ea-abd9-692bbfb3f958 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:11.638324 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09d8afa9-5e6f-46ea-abd9-692bbfb3f958 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:11.639671 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d8afa9-5e6f-46ea-abd9-692bbfb3f958 None admin] RBAC: Adding query filter params (role.id=c73e9539582145ed8eedc48648b9d738, scope.project.id=838e996d09a0454b9bcdc5aef03ef203, user.id=f66a877fdca340f48f54b48e5367a194) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:11.640213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d8afa9-5e6f-46ea-abd9-692bbfb3f958 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:11.643065 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09d8afa9-5e6f-46ea-abd9-692bbfb3f958 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:11.662568 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 432/864] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:53:11 2022] GET /identity/v3/role_assignments?user.id=f66a877fdca340f48f54b48e5367a194&scope.project.id=838e996d09a0454b9bcdc5aef03ef203&role.id=c73e9539582145ed8eedc48648b9d738 => generated 608 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:11.662568 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8afa9-5e6f-46ea-abd9-692bbfb3f958 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:11.727720 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:11.782280 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e16a387c-3584-41ca-909c-dcd6a9afed1b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:11.852438 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00961d-f775-4f85-ae7d-d88e28d1cf97 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:11.853530 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00961d-f775-4f85-ae7d-d88e28d1cf97 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:11.854083 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00961d-f775-4f85-ae7d-d88e28d1cf97 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:11.854747 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb00961d-f775-4f85-ae7d-d88e28d1cf97 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:11.856071 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00961d-f775-4f85-ae7d-d88e28d1cf97 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:11.858650 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb00961d-f775-4f85-ae7d-d88e28d1cf97 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:11.876758 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09d8afa9-5e6f-46ea-abd9-692bbfb3f958 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:11.892772 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 433/865] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 21 00:53:11 2022] POST /identity/v3/services => generated 251 bytes in 325 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:53:11.950024 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c46042-8048-40ba-bc9b-090b8d607505 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:11.951035 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c46042-8048-40ba-bc9b-090b8d607505 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:11.951505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c46042-8048-40ba-bc9b-090b8d607505 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:11.951952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99c46042-8048-40ba-bc9b-090b8d607505 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:11.964968 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c46042-8048-40ba-bc9b-090b8d607505 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:11.966716 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99c46042-8048-40ba-bc9b-090b8d607505 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:11.971050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:11.984885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-99c46042-8048-40ba-bc9b-090b8d607505 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:53:11.984885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:11.984885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:11.984885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:11.984885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:11.984885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:11.984885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:11.984885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:11.984885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:11.984885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:11.984885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:11.984885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:11.984885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:53:11.984885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:53:11.984885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:53:11.984885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:53:11.986729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:11.986729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:11.986729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:53:11.986729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:11.986729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:53:11.986729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:11.986729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:11.986729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:11.986729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:11.986729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:11.986729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:11.986729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:11.986729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:11.986729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:11.986729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:11.986729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:11.986729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:11.986729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:11.989269 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:11.989269 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:11.989269 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:53:11.989269 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:53:11.989269 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:53:11.989269 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:53:11.989269 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:53:11.989269 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:53:11.989269 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:53:11.989269 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:11.992857 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 433/866] 10.222.0.49 () {56 vars in 1117 bytes} [Sun Aug 21 00:53:11 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 333 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:11.994799 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00961d-f775-4f85-ae7d-d88e28d1cf97 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:12.188533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb00961d-f775-4f85-ae7d-d88e28d1cf97 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:12.259233 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c3f91-357e-412b-845d-f0261cb48e49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:12.260875 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c3f91-357e-412b-845d-f0261cb48e49 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:12.261843 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c3f91-357e-412b-845d-f0261cb48e49 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:12.262410 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-467c3f91-357e-412b-845d-f0261cb48e49 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:12.263459 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c3f91-357e-412b-845d-f0261cb48e49 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:12.264242 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c3f91-357e-412b-845d-f0261cb48e49 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:12.267436 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-467c3f91-357e-412b-845d-f0261cb48e49 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:12.271691 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:12.302553 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 434/867] 10.222.0.49 () {56 vars in 1149 bytes} [Sun Aug 21 00:53:11 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 309 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:12.312042 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c46042-8048-40ba-bc9b-090b8d607505 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:12.440347 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99c46042-8048-40ba-bc9b-090b8d607505 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:12.484376 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17444d3b-5962-40e1-91a0-5e442a78a10b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:12.485839 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17444d3b-5962-40e1-91a0-5e442a78a10b None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:12.486608 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17444d3b-5962-40e1-91a0-5e442a78a10b None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:12.487306 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17444d3b-5962-40e1-91a0-5e442a78a10b None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:12.588938 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:12.594725 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17444d3b-5962-40e1-91a0-5e442a78a10b None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:12.597242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17444d3b-5962-40e1-91a0-5e442a78a10b None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:12.784328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 434/868] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:53:12 2022] GET /identity/v3/auth/tokens => generated 1262 bytes in 473 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:53:12.792937 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c3f91-357e-412b-845d-f0261cb48e49 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:12.986260 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-467c3f91-357e-412b-845d-f0261cb48e49 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:13.050619 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c1ddc-d9c5-4bee-ba4f-5c07b54ba1d6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:13.051212 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c1ddc-d9c5-4bee-ba4f-5c07b54ba1d6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:13.051539 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c1ddc-d9c5-4bee-ba4f-5c07b54ba1d6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:13.051878 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed4c1ddc-d9c5-4bee-ba4f-5c07b54ba1d6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:13.066698 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c1ddc-d9c5-4bee-ba4f-5c07b54ba1d6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:13.069473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed4c1ddc-d9c5-4bee-ba4f-5c07b54ba1d6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:13.097838 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ed4c1ddc-d9c5-4bee-ba4f-5c07b54ba1d6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:13.097838 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:13.097838 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:13.097838 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:13.097838 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:13.097838 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:13.097838 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:13.097838 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:13.097838 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:13.097838 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:13.097838 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:13.097838 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:13.097838 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:13.097838 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:13.097838 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:13.097838 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:13.099760 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:13.099760 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:13.099760 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:13.099760 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:13.099760 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:13.099760 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:13.099760 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:13.099760 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:13.099760 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:13.099760 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:13.099760 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:13.099760 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:13.099760 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:13.099760 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:13.099760 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:13.099760 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:13.099760 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:13.101628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:13.101628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:13.101628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:13.101628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 435/869] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:12 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:13.107629 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17444d3b-5962-40e1-91a0-5e442a78a10b None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:13.301829 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:13.307762 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17444d3b-5962-40e1-91a0-5e442a78a10b None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:13.383610 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6a3ed86-da2f-4c91-b12d-f29d4cc9e5b0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:13.386170 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3ed86-da2f-4c91-b12d-f29d4cc9e5b0 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:13.387098 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3ed86-da2f-4c91-b12d-f29d4cc9e5b0 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:13.387913 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6a3ed86-da2f-4c91-b12d-f29d4cc9e5b0 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:13.389766 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3ed86-da2f-4c91-b12d-f29d4cc9e5b0 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:13.390683 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3ed86-da2f-4c91-b12d-f29d4cc9e5b0 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:13.393846 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6a3ed86-da2f-4c91-b12d-f29d4cc9e5b0 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:13.421096 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 435/870] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:13.429649 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c1ddc-d9c5-4bee-ba4f-5c07b54ba1d6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:13.523426 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:13.635321 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed4c1ddc-d9c5-4bee-ba4f-5c07b54ba1d6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:13.641203 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd53b5e-7eb6-4c26-97c0-b544b795860e None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:13.641854 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd53b5e-7eb6-4c26-97c0-b544b795860e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:13.642360 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bd53b5e-7eb6-4c26-97c0-b544b795860e None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:13.645175 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 436/871] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:13 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:53:13.653354 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07502bac-bfe2-4843-8f42-7543f3935ac8 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:13.654274 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07502bac-bfe2-4843-8f42-7543f3935ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:13.654832 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07502bac-bfe2-4843-8f42-7543f3935ac8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:13.675562 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-07502bac-bfe2-4843-8f42-7543f3935ac8 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:13.677254 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-07502bac-bfe2-4843-8f42-7543f3935ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:13.702436 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597eddc-d5ff-41b3-8ca4-e3f7caf4c6eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:13.703446 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597eddc-d5ff-41b3-8ca4-e3f7caf4c6eb None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:13.703997 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597eddc-d5ff-41b3-8ca4-e3f7caf4c6eb None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:13.704332 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3597eddc-d5ff-41b3-8ca4-e3f7caf4c6eb None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:13.716002 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3597eddc-d5ff-41b3-8ca4-e3f7caf4c6eb None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:13.718729 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3597eddc-d5ff-41b3-8ca4-e3f7caf4c6eb None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:13.741106 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-3597eddc-d5ff-41b3-8ca4-e3f7caf4c6eb None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:13.741106 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:13.741106 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:13.741106 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:13.741106 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:13.741106 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:13.741106 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:13.741106 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:13.741106 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:13.741106 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:13.741106 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:13.741106 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:13.741106 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:53:13.741106 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:53:13.741106 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:53:13.742964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:53:13.742964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:13.742964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:13.742964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:13.742964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:13.742964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:13.742964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:13.742964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:13.742964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:13.742964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:13.742964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:13.742964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:13.742964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:13.742964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:13.742964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:13.742964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:13.742964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:13.744811 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:53:13.744811 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:53:13.744811 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:53:13.744811 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:53:13.744811 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:53:13.744811 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:53:13.744811 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:13.744811 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:13.744811 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 436/872] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:53:13 2022] GET /identity/v3/projects/service => generated 88 bytes in 316 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:13.752819 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597eddc-d5ff-41b3-8ca4-e3f7caf4c6eb None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:13.835812 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 437/873] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:13 2022] POST /identity/v3/auth/tokens => generated 1262 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:53:13.954144 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3597eddc-d5ff-41b3-8ca4-e3f7caf4c6eb None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:13.958815 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:14.020468 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733d76f-c5a1-43e3-a95b-988aea177b96 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:14.021545 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733d76f-c5a1-43e3-a95b-988aea177b96 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:14.022034 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733d76f-c5a1-43e3-a95b-988aea177b96 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:14.022518 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2733d76f-c5a1-43e3-a95b-988aea177b96 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:14.023795 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733d76f-c5a1-43e3-a95b-988aea177b96 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:14.024316 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733d76f-c5a1-43e3-a95b-988aea177b96 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:14.027118 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2733d76f-c5a1-43e3-a95b-988aea177b96 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:14.053871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 437/874] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:53:13 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:14.063991 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07502bac-bfe2-4843-8f42-7543f3935ac8 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:14.253246 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:14.273357 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07502bac-bfe2-4843-8f42-7543f3935ac8 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:14.347570 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e67a24c0-f606-42c0-aba8-c7a0a71999e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:14.348604 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a24c0-f606-42c0-aba8-c7a0a71999e6 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:14.348806 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733d76f-c5a1-43e3-a95b-988aea177b96 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:14.349102 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a24c0-f606-42c0-aba8-c7a0a71999e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:14.349711 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e67a24c0-f606-42c0-aba8-c7a0a71999e6 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:14.351033 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a24c0-f606-42c0-aba8-c7a0a71999e6 None admin] RBAC: Adding query filter params (role.id=b549ba322af24099825f8949d2060adf, scope.project.id=838e996d09a0454b9bcdc5aef03ef203, user.id=a06f043017114f9090264293f5ede6c4) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:14.351557 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a24c0-f606-42c0-aba8-c7a0a71999e6 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:14.354568 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e67a24c0-f606-42c0-aba8-c7a0a71999e6 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:14.367337 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 438/875] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:53:14 2022] GET /identity/v3/role_assignments?user.id=a06f043017114f9090264293f5ede6c4&scope.project.id=838e996d09a0454b9bcdc5aef03ef203&role.id=b549ba322af24099825f8949d2060adf => generated 608 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:14.551532 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2733d76f-c5a1-43e3-a95b-988aea177b96 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:14.623233 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-09ad2d04-3b55-4503-9dc1-5e832e23e110 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:14.624263 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad2d04-3b55-4503-9dc1-5e832e23e110 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:14.624749 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad2d04-3b55-4503-9dc1-5e832e23e110 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:14.625553 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-09ad2d04-3b55-4503-9dc1-5e832e23e110 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:14.626741 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad2d04-3b55-4503-9dc1-5e832e23e110 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:14.629404 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-09ad2d04-3b55-4503-9dc1-5e832e23e110 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:14.657982 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 438/876] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 21 00:53:14 2022] POST /identity/v3/services => generated 269 bytes in 310 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:53:15.071154 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8737ea0-ab84-4bd4-90a7-7a09f7922772 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:15.072124 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8737ea0-ab84-4bd4-90a7-7a09f7922772 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:15.072124 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8737ea0-ab84-4bd4-90a7-7a09f7922772 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:15.074862 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 439/877] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:15.081013 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723aed6-0b36-4a2b-bd10-e5f659748a01 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:15.081920 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723aed6-0b36-4a2b-bd10-e5f659748a01 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:15.082192 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b723aed6-0b36-4a2b-bd10-e5f659748a01 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:15.083046 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6990e3-ae96-4eaf-bee3-f37f809cf2bc None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:15.083532 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6990e3-ae96-4eaf-bee3-f37f809cf2bc None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:15.084000 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b6990e3-ae96-4eaf-bee3-f37f809cf2bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:15.085027 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 439/878] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:15 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:15.094335 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca3551-5bd7-4f35-a57e-55bc3beb8592 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:15.095209 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca3551-5bd7-4f35-a57e-55bc3beb8592 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:15.095942 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b4ca3551-5bd7-4f35-a57e-55bc3beb8592 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:15.114554 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-1b6990e3-ae96-4eaf-bee3-f37f809cf2bc None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:15.116478 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-1b6990e3-ae96-4eaf-bee3-f37f809cf2bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:15.126076 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-b4ca3551-5bd7-4f35-a57e-55bc3beb8592 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:15.128371 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b4ca3551-5bd7-4f35-a57e-55bc3beb8592 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:15.166401 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:15.285318 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 440/879] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:15 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:53:15.291482 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 440/880] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:15 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 199 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:15.770891 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6990e3-ae96-4eaf-bee3-f37f809cf2bc None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:15.790971 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca3551-5bd7-4f35-a57e-55bc3beb8592 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:15.946443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:15.985384 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b6990e3-ae96-4eaf-bee3-f37f809cf2bc None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:15.988250 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b4ca3551-5bd7-4f35-a57e-55bc3beb8592 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:16.047923 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19e2f7-6b3b-4422-a004-7fc030c0b9e6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:16.049331 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19e2f7-6b3b-4422-a004-7fc030c0b9e6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:16.050004 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19e2f7-6b3b-4422-a004-7fc030c0b9e6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:16.050707 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df19e2f7-6b3b-4422-a004-7fc030c0b9e6 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:16.051859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19e2f7-6b3b-4422-a004-7fc030c0b9e6 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:16.052591 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee3ee7-320f-4af5-a294-a7e427685302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:16.053620 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee3ee7-320f-4af5-a294-a7e427685302 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:16.054066 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee3ee7-320f-4af5-a294-a7e427685302 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:16.054469 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00ee3ee7-320f-4af5-a294-a7e427685302 None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:16.055365 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee3ee7-320f-4af5-a294-a7e427685302 None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:16.055833 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-df19e2f7-6b3b-4422-a004-7fc030c0b9e6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:16.057929 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00ee3ee7-320f-4af5-a294-a7e427685302 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:16.070804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-df19e2f7-6b3b-4422-a004-7fc030c0b9e6 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:53:16.070804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:16.070804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:53:16.070804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:53:16.070804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:53:16.070804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:53:16.070804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:53:16.070804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:16.070804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:53:16.070804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:16.070804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:53:16.070804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:16.070804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:16.070804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:16.070804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:16.070804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:16.070804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:16.072400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:16.072400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:16.072400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:16.072400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:16.072400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:16.072400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:16.072400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:53:16.072400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:53:16.072400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:53:16.072400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:53:16.072400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:16.072400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:16.072400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:16.072400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:16.072400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:16.072400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:16.073871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:16.073871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:16.073871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:16.073871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:16.073871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:16.073871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:16.073871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:16.073871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:16.073871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:16.073871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:16.073871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:53:16.073871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:16.073871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:53:16.073871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:16.074993 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-00ee3ee7-320f-4af5-a294-a7e427685302 None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 00:53:16.074993 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:16.074993 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:53:16.074993 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:53:16.074993 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:53:16.074993 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:53:16.074993 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:53:16.074993 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:16.074993 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 00:53:16.074993 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:16.074993 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:53:16.074993 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:16.074993 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:16.074993 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:16.074993 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:16.074993 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:16.074993 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:16.076773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:16.076773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:16.076773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:16.076773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:16.076773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:16.076773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:16.076773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:53:16.076773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:53:16.076773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:53:16.076773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:53:16.076773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:16.076773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:16.076773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:16.076773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:16.076773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:16.076773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:16.078926 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:16.078926 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:16.078926 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:16.078926 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:16.078926 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:16.078926 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:16.078926 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:16.078926 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:16.078926 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:16.078926 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:16.078926 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:53:16.078926 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:16.078926 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 00:53:16.078926 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:16.084626 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 441/881] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 21 00:53:15 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:16.086592 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee3ee7-320f-4af5-a294-a7e427685302 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:16.087181 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 441/882] 10.222.0.49 () {56 vars in 1126 bytes} [Sun Aug 21 00:53:15 2022] GET /identity/v3/services/object-store => generated 93 bytes in 292 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:16.090338 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19e2f7-6b3b-4422-a004-7fc030c0b9e6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:16.120363 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:16.274996 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-df19e2f7-6b3b-4422-a004-7fc030c0b9e6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:16.306363 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00ee3ee7-320f-4af5-a294-a7e427685302 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:16.334792 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddea065-0f29-4a66-a401-427fa52c7900 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:16.335598 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddea065-0f29-4a66-a401-427fa52c7900 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:16.335951 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddea065-0f29-4a66-a401-427fa52c7900 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:16.336294 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ddea065-0f29-4a66-a401-427fa52c7900 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:16.337547 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddea065-0f29-4a66-a401-427fa52c7900 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:16.337952 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddea065-0f29-4a66-a401-427fa52c7900 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:16.340347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7ddea065-0f29-4a66-a401-427fa52c7900 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:16.357896 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 442/883] 10.222.0.49 () {56 vars in 1122 bytes} [Sun Aug 21 00:53:16 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:16.360411 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddea065-0f29-4a66-a401-427fa52c7900 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:16.380960 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35d249-3fba-4330-a06c-905d5fda6bd7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:16.382492 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35d249-3fba-4330-a06c-905d5fda6bd7 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:16.383282 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35d249-3fba-4330-a06c-905d5fda6bd7 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:16.384120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec35d249-3fba-4330-a06c-905d5fda6bd7 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:16.385772 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35d249-3fba-4330-a06c-905d5fda6bd7 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:16.386561 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35d249-3fba-4330-a06c-905d5fda6bd7 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:16.389674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec35d249-3fba-4330-a06c-905d5fda6bd7 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:16.405247 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 442/884] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 21 00:53:16 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 314 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:16.409819 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35d249-3fba-4330-a06c-905d5fda6bd7 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:16.441653 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:16.490342 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:16.530801 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ddea065-0f29-4a66-a401-427fa52c7900 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:16.610428 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec35d249-3fba-4330-a06c-905d5fda6bd7 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:16.613286 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9adf32-308f-49d1-8790-bca77adb9711 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:16.614452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9adf32-308f-49d1-8790-bca77adb9711 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:16.614907 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9adf32-308f-49d1-8790-bca77adb9711 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:16.615379 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c9adf32-308f-49d1-8790-bca77adb9711 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:16.616524 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9adf32-308f-49d1-8790-bca77adb9711 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:16.618272 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9adf32-308f-49d1-8790-bca77adb9711 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:16.619807 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c9adf32-308f-49d1-8790-bca77adb9711 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:16.629935 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 443/885] 10.222.0.49 () {56 vars in 1122 bytes} [Sun Aug 21 00:53:16 2022] GET /identity/v3/services?type=object-store => generated 129 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:16.678641 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79db75-b81e-48fd-ac9b-8a372f41b1e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:16.679941 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79db75-b81e-48fd-ac9b-8a372f41b1e9 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:16.680663 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79db75-b81e-48fd-ac9b-8a372f41b1e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:16.681318 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ef79db75-b81e-48fd-ac9b-8a372f41b1e9 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:16.682803 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79db75-b81e-48fd-ac9b-8a372f41b1e9 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:16.683476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79db75-b81e-48fd-ac9b-8a372f41b1e9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:16.686043 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ef79db75-b81e-48fd-ac9b-8a372f41b1e9 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:16.700835 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 443/886] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 21 00:53:16 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:16.706180 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9adf32-308f-49d1-8790-bca77adb9711 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:16.919891 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c9adf32-308f-49d1-8790-bca77adb9711 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:16.990487 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87259ba8-0f72-4f11-82c6-e978bbe02f7b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:16.991430 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87259ba8-0f72-4f11-82c6-e978bbe02f7b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:16.991811 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87259ba8-0f72-4f11-82c6-e978bbe02f7b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:16.992181 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87259ba8-0f72-4f11-82c6-e978bbe02f7b None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:16.993293 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87259ba8-0f72-4f11-82c6-e978bbe02f7b None admin] RBAC: Adding query filter params (interface=public, service_id=130016f280264d2f912c7e6726521782, region_id=RegionOne) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:16.993746 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87259ba8-0f72-4f11-82c6-e978bbe02f7b None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:16.996494 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87259ba8-0f72-4f11-82c6-e978bbe02f7b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:17.012126 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 444/887] 10.222.0.49 () {56 vars in 1251 bytes} [Sun Aug 21 00:53:16 2022] GET /identity/v3/endpoints?service_id=130016f280264d2f912c7e6726521782&interface=public®ion_id=RegionOne => generated 194 bytes in 307 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:17.021279 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79db75-b81e-48fd-ac9b-8a372f41b1e9 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:17.151169 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:17.231608 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ef79db75-b81e-48fd-ac9b-8a372f41b1e9 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:17.296767 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57172cc5-f88d-4c08-b816-eaede580c2c2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:17.298232 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57172cc5-f88d-4c08-b816-eaede580c2c2 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:17.298977 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57172cc5-f88d-4c08-b816-eaede580c2c2 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:17.299665 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57172cc5-f88d-4c08-b816-eaede580c2c2 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:17.300961 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57172cc5-f88d-4c08-b816-eaede580c2c2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:17.303690 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-57172cc5-f88d-4c08-b816-eaede580c2c2 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:17.321256 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 444/888] 10.222.0.49 () {56 vars in 1087 bytes} [Sun Aug 21 00:53:17 2022] GET /identity/v3/services => generated 1268 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 00:53:17.834497 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ab25e-2463-4b16-87ac-1ff6bf421c81 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:17.835450 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ab25e-2463-4b16-87ac-1ff6bf421c81 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:17.835450 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-822ab25e-2463-4b16-87ac-1ff6bf421c81 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:17.838147 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 445/889] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:17.847891 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bcfa4-f408-40ee-8248-986d2d106ada None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:17.848376 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bcfa4-f408-40ee-8248-986d2d106ada None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:17.848970 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9c8bcfa4-f408-40ee-8248-986d2d106ada None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:17.861628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f0c58-8f00-43f1-a79d-7490f916ca71 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:17.862105 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f0c58-8f00-43f1-a79d-7490f916ca71 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:17.862595 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d99f0c58-8f00-43f1-a79d-7490f916ca71 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:17.866153 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 446/890] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:17 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:53:17.881895 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422d11c-5724-4b8e-bda5-09bdf5aea2a3 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:17.882219 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-9c8bcfa4-f408-40ee-8248-986d2d106ada None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:17.882711 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422d11c-5724-4b8e-bda5-09bdf5aea2a3 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:17.883307 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8422d11c-5724-4b8e-bda5-09bdf5aea2a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:17.884107 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-9c8bcfa4-f408-40ee-8248-986d2d106ada None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:17.930533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-8422d11c-5724-4b8e-bda5-09bdf5aea2a3 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:17.933102 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8422d11c-5724-4b8e-bda5-09bdf5aea2a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:17.939723 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:18.023905 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 445/891] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:18.093281 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 447/892] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:17 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:53:18.497948 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bcfa4-f408-40ee-8248-986d2d106ada None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:18.570982 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422d11c-5724-4b8e-bda5-09bdf5aea2a3 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:18.636147 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:18.720753 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9c8bcfa4-f408-40ee-8248-986d2d106ada None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:18.794600 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e113e3c-30dc-41c9-9828-e8e4bab1955f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:18.795434 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8422d11c-5724-4b8e-bda5-09bdf5aea2a3 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:18.796208 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e113e3c-30dc-41c9-9828-e8e4bab1955f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:18.796888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e113e3c-30dc-41c9-9828-e8e4bab1955f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:18.797574 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e113e3c-30dc-41c9-9828-e8e4bab1955f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:18.799059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e113e3c-30dc-41c9-9828-e8e4bab1955f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:18.802053 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e113e3c-30dc-41c9-9828-e8e4bab1955f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:18.820638 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-5e113e3c-30dc-41c9-9828-e8e4bab1955f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 00:53:18.820638 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:18.820638 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:53:18.820638 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:53:18.820638 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:53:18.820638 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:53:18.820638 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:53:18.820638 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:18.820638 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 00:53:18.820638 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:18.820638 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:53:18.820638 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:18.820638 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:18.820638 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:18.820638 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:18.820638 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:18.822718 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:18.822718 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:18.822718 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:18.822718 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:18.822718 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:18.822718 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:18.822718 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:18.822718 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:53:18.822718 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:53:18.822718 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:53:18.822718 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:53:18.822718 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:18.822718 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:18.822718 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:18.822718 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:18.822718 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:18.822718 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:18.824509 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:18.824509 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:18.824509 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:18.824509 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:18.824509 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:18.824509 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:18.824509 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:18.824509 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:18.824509 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:18.824509 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:18.824509 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:53:18.824509 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:18.824509 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 00:53:18.824509 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:18.829136 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 446/893] 10.222.0.49 () {56 vars in 1132 bytes} [Sun Aug 21 00:53:18 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:18.842667 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e113e3c-30dc-41c9-9828-e8e4bab1955f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:18.860972 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865583af-cf0d-4e51-9f52-fd46a6ed9c43 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:18.862134 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865583af-cf0d-4e51-9f52-fd46a6ed9c43 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:18.862606 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865583af-cf0d-4e51-9f52-fd46a6ed9c43 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:18.863052 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-865583af-cf0d-4e51-9f52-fd46a6ed9c43 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:18.880827 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:18.888740 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-865583af-cf0d-4e51-9f52-fd46a6ed9c43 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:53:18.899831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-865583af-cf0d-4e51-9f52-fd46a6ed9c43 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:53:18.899831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:18.899831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:18.899831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:18.899831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:18.899831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:18.899831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:18.899831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:18.899831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:18.899831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:18.899831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:18.899831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:18.899831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:53:18.899831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:53:18.899831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:53:18.899831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:53:18.901878 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:53:18.901878 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:53:18.901878 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:53:18.901878 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:53:18.901878 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:18.901878 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:18.901878 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:18.901878 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:18.901878 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:18.901878 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:18.901878 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:18.901878 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:18.901878 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:18.901878 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:18.901878 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:18.901878 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:18.903463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:18.903463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:18.903463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:18.903463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:18.903463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:53:18.903463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:53:18.903463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:53:18.903463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:53:18.903463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:53:18.903463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:53:18.903463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:53:18.903463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:18.903463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 448/894] 10.222.0.49 () {56 vars in 1120 bytes} [Sun Aug 21 00:53:18 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 332 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:53:18.915043 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865583af-cf0d-4e51-9f52-fd46a6ed9c43 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:19.077912 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-865583af-cf0d-4e51-9f52-fd46a6ed9c43 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:19.080709 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e113e3c-30dc-41c9-9828-e8e4bab1955f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:19.133563 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24c42b-0e2d-427c-b31a-9ba2158573d2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:19.134568 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24c42b-0e2d-427c-b31a-9ba2158573d2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:19.135541 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24c42b-0e2d-427c-b31a-9ba2158573d2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:19.136300 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a24c42b-0e2d-427c-b31a-9ba2158573d2 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:19.138437 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24c42b-0e2d-427c-b31a-9ba2158573d2 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:19.139558 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24c42b-0e2d-427c-b31a-9ba2158573d2 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:19.141923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:19.142582 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a24c42b-0e2d-427c-b31a-9ba2158573d2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:19.155195 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d22b4-f70a-4c01-a2d6-c9c4687fa7e8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:19.156831 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d22b4-f70a-4c01-a2d6-c9c4687fa7e8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:19.157702 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d22b4-f70a-4c01-a2d6-c9c4687fa7e8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:19.158526 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2a8d22b4-f70a-4c01-a2d6-c9c4687fa7e8 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:19.160079 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d22b4-f70a-4c01-a2d6-c9c4687fa7e8 None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:19.160976 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 449/895] 10.222.0.49 () {56 vars in 1115 bytes} [Sun Aug 21 00:53:18 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:19.161276 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d22b4-f70a-4c01-a2d6-c9c4687fa7e8 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:19.163954 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2a8d22b4-f70a-4c01-a2d6-c9c4687fa7e8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:19.169137 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24c42b-0e2d-427c-b31a-9ba2158573d2 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:19.184864 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 447/896] 10.222.0.49 () {56 vars in 1126 bytes} [Sun Aug 21 00:53:18 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 337 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:19.187153 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d22b4-f70a-4c01-a2d6-c9c4687fa7e8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:19.325084 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:19.394547 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2a8d22b4-f70a-4c01-a2d6-c9c4687fa7e8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:19.421858 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a24c42b-0e2d-427c-b31a-9ba2158573d2 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:19.464544 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74788f12-8f77-46f7-8116-c6cc59b31f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:19.465873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74788f12-8f77-46f7-8116-c6cc59b31f79 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:19.466544 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74788f12-8f77-46f7-8116-c6cc59b31f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:19.467309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74788f12-8f77-46f7-8116-c6cc59b31f79 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:19.469013 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74788f12-8f77-46f7-8116-c6cc59b31f79 None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:19.469719 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74788f12-8f77-46f7-8116-c6cc59b31f79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:19.472427 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74788f12-8f77-46f7-8116-c6cc59b31f79 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:19.490220 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 448/897] 10.222.0.49 () {56 vars in 1126 bytes} [Sun Aug 21 00:53:19 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 304 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:19.493291 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74788f12-8f77-46f7-8116-c6cc59b31f79 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:19.508025 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dea6d4-9ee1-4996-8e5e-df98e7a38673 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:19.509598 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dea6d4-9ee1-4996-8e5e-df98e7a38673 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:19.510312 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dea6d4-9ee1-4996-8e5e-df98e7a38673 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:19.511056 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83dea6d4-9ee1-4996-8e5e-df98e7a38673 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:19.536743 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dea6d4-9ee1-4996-8e5e-df98e7a38673 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:19.540868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-83dea6d4-9ee1-4996-8e5e-df98e7a38673 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:19.578211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-83dea6d4-9ee1-4996-8e5e-df98e7a38673 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:19.578211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:19.578211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:19.578211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:19.578211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:19.578211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:19.578211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:19.578211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:19.578211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:19.578211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:19.578211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:19.578211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:19.578211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:19.578211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:19.578211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:19.578211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:19.580327 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:19.580327 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:19.580327 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:19.580327 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:19.580327 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:19.580327 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:19.580327 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:19.580327 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:19.580327 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:19.580327 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:19.580327 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:19.580327 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:19.580327 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:19.580327 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:19.580327 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:19.580327 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:19.580327 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:19.582550 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:19.582550 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:19.582550 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:19.593798 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 450/898] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 419 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:19.594919 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dea6d4-9ee1-4996-8e5e-df98e7a38673 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:19.639035 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:19.737777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74788f12-8f77-46f7-8116-c6cc59b31f79 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:19.836179 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5366266-81ff-4b1b-b9c7-754b1571deca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:19.844376 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5366266-81ff-4b1b-b9c7-754b1571deca None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:19.845420 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5366266-81ff-4b1b-b9c7-754b1571deca None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:19.846419 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a5366266-81ff-4b1b-b9c7-754b1571deca None admin] PATH_INFO: `/v3/endpoints` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:19.848333 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5366266-81ff-4b1b-b9c7-754b1571deca None admin] RBAC: Adding query filter params (interface=public, service_id=2d5c932b1a4447b9aceaa5638bc67617, region_id=RegionOne) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:19.849264 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5366266-81ff-4b1b-b9c7-754b1571deca None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:19.852223 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a5366266-81ff-4b1b-b9c7-754b1571deca None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:19.854596 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-83dea6d4-9ee1-4996-8e5e-df98e7a38673 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:19.863692 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 449/899] 10.222.0.49 () {56 vars in 1251 bytes} [Sun Aug 21 00:53:19 2022] GET /identity/v3/endpoints?service_id=2d5c932b1a4447b9aceaa5638bc67617&interface=public®ion_id=RegionOne => generated 194 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:19.873176 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5366266-81ff-4b1b-b9c7-754b1571deca None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:19.885787 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:19.929477 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84545f7b-8487-4557-86bd-1b203dd29271 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:19.930627 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84545f7b-8487-4557-86bd-1b203dd29271 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:19.931140 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84545f7b-8487-4557-86bd-1b203dd29271 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:19.931630 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84545f7b-8487-4557-86bd-1b203dd29271 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:19.933071 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84545f7b-8487-4557-86bd-1b203dd29271 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:19.933605 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84545f7b-8487-4557-86bd-1b203dd29271 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:19.936453 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84545f7b-8487-4557-86bd-1b203dd29271 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:19.960937 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 451/900] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 367 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:19.971587 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84545f7b-8487-4557-86bd-1b203dd29271 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:20.092331 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a5366266-81ff-4b1b-b9c7-754b1571deca None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:20.140778 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:20.164990 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2e08836-931e-4c11-b894-a47430cfe409 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:20.166241 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e08836-931e-4c11-b894-a47430cfe409 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:20.166635 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e08836-931e-4c11-b894-a47430cfe409 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:20.167150 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2e08836-931e-4c11-b894-a47430cfe409 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:20.168310 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e08836-931e-4c11-b894-a47430cfe409 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:20.170994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b2e08836-931e-4c11-b894-a47430cfe409 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:20.183230 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 450/901] 10.222.0.49 () {56 vars in 1087 bytes} [Sun Aug 21 00:53:19 2022] GET /identity/v3/services => generated 1268 bytes in 311 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 00:53:20.185379 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a5f5f-bd84-4c0a-b27e-26dfa1766571 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:20.185792 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a5f5f-bd84-4c0a-b27e-26dfa1766571 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:20.186271 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd3a5f5f-bd84-4c0a-b27e-26dfa1766571 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:20.189191 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 451/902] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:20 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:20.205110 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215183ed-f03e-4f85-b3b2-50046103f30c None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:20.205110 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215183ed-f03e-4f85-b3b2-50046103f30c None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:20.205110 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-215183ed-f03e-4f85-b3b2-50046103f30c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:20.239524 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84545f7b-8487-4557-86bd-1b203dd29271 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:20.249857 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-215183ed-f03e-4f85-b3b2-50046103f30c None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:20.252901 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-215183ed-f03e-4f85-b3b2-50046103f30c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:20.310904 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31993da7-8074-4572-9805-c3b075589a2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:20.312039 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31993da7-8074-4572-9805-c3b075589a2f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:20.312548 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31993da7-8074-4572-9805-c3b075589a2f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:20.313023 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31993da7-8074-4572-9805-c3b075589a2f None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:20.327911 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31993da7-8074-4572-9805-c3b075589a2f None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:20.330821 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31993da7-8074-4572-9805-c3b075589a2f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:20.354765 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-31993da7-8074-4572-9805-c3b075589a2f None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:53:20.354765 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:20.354765 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:20.354765 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:20.354765 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:20.354765 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:20.354765 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:20.354765 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:20.354765 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:20.354765 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:20.354765 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:20.354765 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:20.354765 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:53:20.354765 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:53:20.354765 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:53:20.354765 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:53:20.356490 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:20.356490 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:20.356490 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:53:20.356490 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:20.356490 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:53:20.356490 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:20.356490 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:20.356490 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:20.356490 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:20.356490 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:20.356490 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:20.356490 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:20.356490 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:20.356490 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:20.356490 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:20.356490 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:20.356490 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:20.356490 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:20.358877 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:20.358877 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:20.358877 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:53:20.358877 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:53:20.358877 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:53:20.358877 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:53:20.358877 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:53:20.358877 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:53:20.358877 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:53:20.358877 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:20.364545 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 452/903] 10.222.0.49 () {56 vars in 1117 bytes} [Sun Aug 21 00:53:19 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 395 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:20.366193 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31993da7-8074-4572-9805-c3b075589a2f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:20.413272 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 452/904] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:20 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 216 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:53:20.444622 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:20.571614 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31993da7-8074-4572-9805-c3b075589a2f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:20.616235 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76361e-f192-4848-a61e-7a6c9e65edfb None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:20.616648 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76361e-f192-4848-a61e-7a6c9e65edfb None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:20.617129 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c76361e-f192-4848-a61e-7a6c9e65edfb None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:20.625537 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 453/905] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:20 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:20.629532 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd851d0-7ce7-4e25-9a0c-94b25d192d9e None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:20.630113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd851d0-7ce7-4e25-9a0c-94b25d192d9e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:20.630693 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3cd851d0-7ce7-4e25-9a0c-94b25d192d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:20.631962 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b27c7-2106-469c-912c-fc221edd888c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:20.633035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b27c7-2106-469c-912c-fc221edd888c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:20.633556 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b27c7-2106-469c-912c-fc221edd888c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:20.634031 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-308b27c7-2106-469c-912c-fc221edd888c None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:20.635464 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b27c7-2106-469c-912c-fc221edd888c None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:20.636163 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b27c7-2106-469c-912c-fc221edd888c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:20.638990 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-308b27c7-2106-469c-912c-fc221edd888c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:20.661921 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-3cd851d0-7ce7-4e25-9a0c-94b25d192d9e None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:20.664233 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-3cd851d0-7ce7-4e25-9a0c-94b25d192d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:20.680010 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 453/906] 10.222.0.49 () {56 vars in 1149 bytes} [Sun Aug 21 00:53:20 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 315 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:20.688976 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b27c7-2106-469c-912c-fc221edd888c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:20.790850 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 454/907] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:20 2022] POST /identity/v3/auth/tokens => generated 1372 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:20.865978 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:20.889126 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-308b27c7-2106-469c-912c-fc221edd888c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:20.960339 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580303e5-ff18-4c9f-8d97-f46945ee8597 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:20.960621 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd851d0-7ce7-4e25-9a0c-94b25d192d9e None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:20.961441 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580303e5-ff18-4c9f-8d97-f46945ee8597 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:20.961926 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580303e5-ff18-4c9f-8d97-f46945ee8597 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:20.962399 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-580303e5-ff18-4c9f-8d97-f46945ee8597 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:21.089988 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:21.097541 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580303e5-ff18-4c9f-8d97-f46945ee8597 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:21.100909 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-580303e5-ff18-4c9f-8d97-f46945ee8597 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:21.162679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3cd851d0-7ce7-4e25-9a0c-94b25d192d9e None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:21.245317 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831183ca-50be-4d01-930d-13a78eac096a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:21.246671 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831183ca-50be-4d01-930d-13a78eac096a None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:21.247493 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831183ca-50be-4d01-930d-13a78eac096a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:21.248134 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-831183ca-50be-4d01-930d-13a78eac096a None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:21.249582 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831183ca-50be-4d01-930d-13a78eac096a None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:21.252897 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-831183ca-50be-4d01-930d-13a78eac096a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:21.283822 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:21.290219 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 455/908] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 21 00:53:20 2022] POST /identity/v3/services => generated 241 bytes in 331 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:53:21.292295 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831183ca-50be-4d01-930d-13a78eac096a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:21.305602 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 454/909] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:53:20 2022] GET /identity/v3/auth/tokens => generated 1372 bytes in 618 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:53:21.318854 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580303e5-ff18-4c9f-8d97-f46945ee8597 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:21.550149 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-831183ca-50be-4d01-930d-13a78eac096a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:21.552150 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-580303e5-ff18-4c9f-8d97-f46945ee8597 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:21.553198 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:21.622078 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6539ad9-978f-49fd-9f4c-9d85095c8d3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:21.624609 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6539ad9-978f-49fd-9f4c-9d85095c8d3a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:21.626258 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6539ad9-978f-49fd-9f4c-9d85095c8d3a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:21.627036 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6539ad9-978f-49fd-9f4c-9d85095c8d3a None admin] PATH_INFO: `/v3/services/volumev3` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:21.628598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6539ad9-978f-49fd-9f4c-9d85095c8d3a None admin] RBAC: Authorizing `identity:get_service(service_id=volumev3)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:21.631836 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6539ad9-978f-49fd-9f4c-9d85095c8d3a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:21.632075 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545021d-154e-42c6-b82e-44056d51efce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:21.632969 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545021d-154e-42c6-b82e-44056d51efce None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:21.633549 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545021d-154e-42c6-b82e-44056d51efce None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:21.634200 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1545021d-154e-42c6-b82e-44056d51efce None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:21.655275 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545021d-154e-42c6-b82e-44056d51efce None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:21.656248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-c6539ad9-978f-49fd-9f4c-9d85095c8d3a None admin] Could not find service: volumev3.: keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 00:53:21.656248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:21.656248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:53:21.656248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:53:21.656248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:53:21.656248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:53:21.656248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:53:21.656248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:21.656248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 00:53:21.656248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:21.656248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:53:21.656248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:21.656248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:21.656248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:21.656248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:21.656248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:21.656248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:21.658228 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:21.658228 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:21.658228 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:21.658228 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:21.658228 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:21.658228 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:21.658228 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:53:21.658228 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:53:21.658228 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:53:21.658228 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:53:21.658228 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:21.658228 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:21.658228 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:21.658228 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:21.658228 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:21.658228 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:21.659802 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:21.659802 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:21.659802 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:21.659802 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:21.659802 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:21.659802 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:21.659802 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:21.659802 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:21.659802 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:21.659802 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:21.659802 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:53:21.659802 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:21.659802 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: volumev3. Aug 21 00:53:21.659802 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:21.664195 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1545021d-154e-42c6-b82e-44056d51efce None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:21.673414 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 456/910] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 21 00:53:21 2022] GET /identity/v3/services/volumev3 => generated 89 bytes in 376 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:21.687537 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6539ad9-978f-49fd-9f4c-9d85095c8d3a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:21.694674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-1545021d-154e-42c6-b82e-44056d51efce None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:21.694674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:21.694674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:21.694674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:21.694674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:21.694674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:21.694674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:21.694674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:21.694674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:21.694674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:21.694674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:21.694674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:21.694674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:21.694674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:21.694674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:21.694674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:21.696853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:21.696853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:21.696853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:21.696853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:21.696853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:21.696853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:21.696853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:21.696853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:21.696853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:21.696853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:21.696853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:21.696853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:21.696853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:21.696853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:21.696853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:21.696853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:21.696853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:21.698672 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:21.698672 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:21.698672 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:21.698672 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 455/911] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:21 2022] GET /identity/v3/domains/Default => generated 87 bytes in 380 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:21.707225 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545021d-154e-42c6-b82e-44056d51efce None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:21.801428 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:21.916463 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6539ad9-978f-49fd-9f4c-9d85095c8d3a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:21.923445 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1545021d-154e-42c6-b82e-44056d51efce None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:21.987996 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5b3e8-c920-41aa-b29c-4dce4ff0ea16 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:21.989263 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5b3e8-c920-41aa-b29c-4dce4ff0ea16 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:21.989787 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5b3e8-c920-41aa-b29c-4dce4ff0ea16 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:21.990286 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2fa5b3e8-c920-41aa-b29c-4dce4ff0ea16 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:21.991582 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5b3e8-c920-41aa-b29c-4dce4ff0ea16 None admin] RBAC: Adding query filter params (name=volumev3) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:21.992155 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5b3e8-c920-41aa-b29c-4dce4ff0ea16 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:21.994966 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2fa5b3e8-c920-41aa-b29c-4dce4ff0ea16 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:21.997174 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710d8eb-c40c-4322-8235-477f02ada11a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:21.998664 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710d8eb-c40c-4322-8235-477f02ada11a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:21.999461 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710d8eb-c40c-4322-8235-477f02ada11a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:22.000513 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5710d8eb-c40c-4322-8235-477f02ada11a None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:22.001987 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5710d8eb-c40c-4322-8235-477f02ada11a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:22.002836 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5710d8eb-c40c-4322-8235-477f02ada11a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:22.005995 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5710d8eb-c40c-4322-8235-477f02ada11a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:22.013247 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 457/912] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 21 00:53:21 2022] GET /identity/v3/services?name=volumev3 => generated 125 bytes in 319 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:22.016153 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5b3e8-c920-41aa-b29c-4dce4ff0ea16 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:22.032546 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 456/913] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:21 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 326 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:22.041817 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710d8eb-c40c-4322-8235-477f02ada11a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:22.079774 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:22.224841 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2fa5b3e8-c920-41aa-b29c-4dce4ff0ea16 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:22.265896 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5710d8eb-c40c-4322-8235-477f02ada11a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:22.271442 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:22.297788 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae063a-05dd-48aa-accc-6cad13aeaf84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:22.299055 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae063a-05dd-48aa-accc-6cad13aeaf84 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:22.299720 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae063a-05dd-48aa-accc-6cad13aeaf84 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:22.300325 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cae063a-05dd-48aa-accc-6cad13aeaf84 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:22.301761 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae063a-05dd-48aa-accc-6cad13aeaf84 None admin] RBAC: Adding query filter params (type=volumev3) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:22.302673 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae063a-05dd-48aa-accc-6cad13aeaf84 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:22.305362 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2cae063a-05dd-48aa-accc-6cad13aeaf84 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:22.322072 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 458/914] 10.222.0.49 () {56 vars in 1114 bytes} [Sun Aug 21 00:53:22 2022] GET /identity/v3/services?type=volumev3 => generated 362 bytes in 303 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:22.326977 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae063a-05dd-48aa-accc-6cad13aeaf84 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:22.345177 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba752d65-75a6-4680-8a1a-d372b64a6f4f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:22.346749 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba752d65-75a6-4680-8a1a-d372b64a6f4f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:22.347435 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba752d65-75a6-4680-8a1a-d372b64a6f4f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:22.348141 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba752d65-75a6-4680-8a1a-d372b64a6f4f None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:22.362797 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba752d65-75a6-4680-8a1a-d372b64a6f4f None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:22.365985 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ba752d65-75a6-4680-8a1a-d372b64a6f4f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:22.387655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ba752d65-75a6-4680-8a1a-d372b64a6f4f None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:22.387655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:22.387655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:22.387655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:22.387655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:22.387655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:22.387655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:22.387655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:22.387655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:22.387655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:22.387655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:22.387655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:22.387655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:53:22.387655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:53:22.387655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:53:22.389481 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:53:22.389481 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:22.389481 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:22.389481 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:22.389481 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:22.389481 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:22.389481 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:22.389481 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:22.389481 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:22.389481 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:22.389481 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:22.389481 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:22.389481 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:22.389481 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:22.389481 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:22.389481 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:22.389481 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:22.391250 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:53:22.391250 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:53:22.391250 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:53:22.391250 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:53:22.391250 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:53:22.391250 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:53:22.391250 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:22.391250 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:22.395355 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 457/915] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:53:22 2022] GET /identity/v3/projects/service => generated 88 bytes in 355 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:22.404089 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba752d65-75a6-4680-8a1a-d372b64a6f4f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:22.535685 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:22.552175 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2cae063a-05dd-48aa-accc-6cad13aeaf84 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:22.617198 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba752d65-75a6-4680-8a1a-d372b64a6f4f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:22.623980 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48604363-ff4c-436c-a44b-d31504ec1685 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:22.625863 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48604363-ff4c-436c-a44b-d31504ec1685 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:22.626621 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48604363-ff4c-436c-a44b-d31504ec1685 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:22.627373 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-48604363-ff4c-436c-a44b-d31504ec1685 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:22.628878 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48604363-ff4c-436c-a44b-d31504ec1685 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:22.631777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-48604363-ff4c-436c-a44b-d31504ec1685 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:22.683241 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 459/916] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 21 00:53:22 2022] POST /identity/v3/endpoints => generated 346 bytes in 357 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:53:22.717036 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4b937ac-9363-413f-987d-862cc06dfa39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:22.718217 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b937ac-9363-413f-987d-862cc06dfa39 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:22.718677 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b937ac-9363-413f-987d-862cc06dfa39 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:22.719164 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4b937ac-9363-413f-987d-862cc06dfa39 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:22.720606 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b937ac-9363-413f-987d-862cc06dfa39 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:22.721281 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b937ac-9363-413f-987d-862cc06dfa39 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:22.724814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4b937ac-9363-413f-987d-862cc06dfa39 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:22.751625 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 458/917] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:53:22 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 348 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:22.761475 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48604363-ff4c-436c-a44b-d31504ec1685 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:22.978812 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-48604363-ff4c-436c-a44b-d31504ec1685 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:23.036661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d7ad5f2-7c06-43ca-a49a-7d994ce57f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:23.037370 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ad5f2-7c06-43ca-a49a-7d994ce57f2a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:23.037806 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ad5f2-7c06-43ca-a49a-7d994ce57f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:23.038225 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d7ad5f2-7c06-43ca-a49a-7d994ce57f2a None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:23.039334 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ad5f2-7c06-43ca-a49a-7d994ce57f2a None admin] RBAC: Adding query filter params (role.id=bfc1c16a629c46a0883a2f7363d940cf, scope.project.id=838e996d09a0454b9bcdc5aef03ef203, user.id=a06f043017114f9090264293f5ede6c4) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:23.039861 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ad5f2-7c06-43ca-a49a-7d994ce57f2a None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:23.042580 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d7ad5f2-7c06-43ca-a49a-7d994ce57f2a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:23.052349 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 460/918] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:53:22 2022] GET /identity/v3/role_assignments?user.id=a06f043017114f9090264293f5ede6c4&scope.project.id=838e996d09a0454b9bcdc5aef03ef203&role.id=bfc1c16a629c46a0883a2f7363d940cf => generated 259 bytes in 292 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:23.658584 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a88de1-ac42-4a31-9751-3998215b9451 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:23.659330 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a88de1-ac42-4a31-9751-3998215b9451 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:23.659616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3a88de1-ac42-4a31-9751-3998215b9451 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:23.662585 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 459/919] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:23 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:23.672245 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fed8c0-1aaf-43d2-8019-b0a032d6f124 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:23.672758 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fed8c0-1aaf-43d2-8019-b0a032d6f124 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:23.673364 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9fed8c0-1aaf-43d2-8019-b0a032d6f124 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:23.706570 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-b9fed8c0-1aaf-43d2-8019-b0a032d6f124 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:23.708954 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b9fed8c0-1aaf-43d2-8019-b0a032d6f124 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:23.728500 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:23.843132 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 461/920] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:23 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:24.362159 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a88de1-ac42-4a31-9751-3998215b9451 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:24.405574 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:24.560243 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3a88de1-ac42-4a31-9751-3998215b9451 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:24.623376 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4e6979cb-7c5d-4b43-8c60-68a54d814a6f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:24.624471 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6979cb-7c5d-4b43-8c60-68a54d814a6f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:24.624961 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6979cb-7c5d-4b43-8c60-68a54d814a6f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:24.625785 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e6979cb-7c5d-4b43-8c60-68a54d814a6f None admin] PATH_INFO: `/v3/services/compute_legacy` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:24.626824 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6979cb-7c5d-4b43-8c60-68a54d814a6f None admin] RBAC: Authorizing `identity:get_service(service_id=compute_legacy)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:24.629419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4e6979cb-7c5d-4b43-8c60-68a54d814a6f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:24.646475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-4e6979cb-7c5d-4b43-8c60-68a54d814a6f None admin] Could not find service: compute_legacy.: keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 00:53:24.646475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:24.646475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:53:24.646475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:53:24.646475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:53:24.646475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:53:24.646475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:53:24.646475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:24.646475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 00:53:24.646475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:24.646475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:53:24.646475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:24.646475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:24.646475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:24.646475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:24.646475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:24.647623 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:24.647623 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:24.647623 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:24.647623 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:24.647623 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:24.647623 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:24.647623 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:24.647623 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:53:24.647623 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:53:24.647623 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:53:24.647623 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:53:24.647623 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:24.647623 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:24.647623 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:24.647623 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:24.647623 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:24.647623 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:24.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:24.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:24.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:24.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:24.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:24.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:24.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:24.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:24.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:24.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:24.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:53:24.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:24.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute_legacy. Aug 21 00:53:24.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:24.649696 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 460/921] 10.222.0.49 () {56 vars in 1132 bytes} [Sun Aug 21 00:53:24 2022] GET /identity/v3/services/compute_legacy => generated 95 bytes in 288 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:24.658971 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fed8c0-1aaf-43d2-8019-b0a032d6f124 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:24.821499 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d3140-12b5-44ee-91a5-331e0c69e731 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:24.822103 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d3140-12b5-44ee-91a5-331e0c69e731 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:24.822384 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da0d3140-12b5-44ee-91a5-331e0c69e731 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:24.825414 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 461/922] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:53:24.834584 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c6636-a30f-4915-91f5-47b72db3d9d9 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:24.835085 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c6636-a30f-4915-91f5-47b72db3d9d9 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:24.835870 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-449c6636-a30f-4915-91f5-47b72db3d9d9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:24.845646 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9fed8c0-1aaf-43d2-8019-b0a032d6f124 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:24.868110 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-449c6636-a30f-4915-91f5-47b72db3d9d9 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:24.870334 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-449c6636-a30f-4915-91f5-47b72db3d9d9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:24.910232 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629f114-437d-403a-846f-f604096098cf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:24.911700 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629f114-437d-403a-846f-f604096098cf None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:24.912429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629f114-437d-403a-846f-f604096098cf None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:24.913166 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d629f114-437d-403a-846f-f604096098cf None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:24.914501 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629f114-437d-403a-846f-f604096098cf None admin] RBAC: Adding query filter params (name=compute_legacy) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:24.915253 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629f114-437d-403a-846f-f604096098cf None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:24.918043 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d629f114-437d-403a-846f-f604096098cf None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:24.927255 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 462/923] 10.222.0.49 () {56 vars in 1126 bytes} [Sun Aug 21 00:53:24 2022] GET /identity/v3/services?name=compute_legacy => generated 131 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:24.936435 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629f114-437d-403a-846f-f604096098cf None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:24.957507 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:25.002701 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 462/924] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:24 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:53:25.149708 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d629f114-437d-403a-846f-f604096098cf None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:25.221086 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120def7-f7b0-4070-b7d3-957c4217747a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:25.221086 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120def7-f7b0-4070-b7d3-957c4217747a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:25.221086 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120def7-f7b0-4070-b7d3-957c4217747a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:25.221086 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f120def7-f7b0-4070-b7d3-957c4217747a None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:25.221648 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120def7-f7b0-4070-b7d3-957c4217747a None admin] RBAC: Adding query filter params (type=compute_legacy) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:25.222206 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120def7-f7b0-4070-b7d3-957c4217747a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:25.224912 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f120def7-f7b0-4070-b7d3-957c4217747a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:25.237023 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 463/925] 10.222.0.49 () {56 vars in 1126 bytes} [Sun Aug 21 00:53:24 2022] GET /identity/v3/services?type=compute_legacy => generated 386 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:25.246813 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c6636-a30f-4915-91f5-47b72db3d9d9 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:25.276203 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:25.325126 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120def7-f7b0-4070-b7d3-957c4217747a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:25.444849 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-449c6636-a30f-4915-91f5-47b72db3d9d9 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:25.475210 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:25.510414 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fe85e-c896-4e54-8225-16aabab9934e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:25.511805 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fe85e-c896-4e54-8225-16aabab9934e None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:25.512480 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fe85e-c896-4e54-8225-16aabab9934e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:25.513187 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f3fe85e-c896-4e54-8225-16aabab9934e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:25.514406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fe85e-c896-4e54-8225-16aabab9934e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:25.516708 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f3fe85e-c896-4e54-8225-16aabab9934e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:25.540470 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f120def7-f7b0-4070-b7d3-957c4217747a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:25.565096 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 463/926] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 21 00:53:25 2022] POST /identity/v3/endpoints => generated 347 bytes in 315 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:53:25.632640 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d541147c-b8c5-4464-8c49-356cc61c301c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:25.633758 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541147c-b8c5-4464-8c49-356cc61c301c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:25.634221 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541147c-b8c5-4464-8c49-356cc61c301c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:25.634690 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d541147c-b8c5-4464-8c49-356cc61c301c None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:25.635791 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541147c-b8c5-4464-8c49-356cc61c301c None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:25.638447 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d541147c-b8c5-4464-8c49-356cc61c301c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:25.656176 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-d541147c-b8c5-4464-8c49-356cc61c301c None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:53:25.656176 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:25.656176 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:53:25.656176 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:53:25.656176 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:53:25.656176 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:53:25.656176 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:53:25.656176 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:25.656176 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:53:25.656176 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:25.656176 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:53:25.656176 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:25.656176 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:25.656176 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:25.656176 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:25.656176 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:25.656176 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:25.658274 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:25.658274 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:25.658274 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:25.658274 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:25.658274 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:25.658274 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:25.658274 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:53:25.658274 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:53:25.658274 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:53:25.658274 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:53:25.658274 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:25.658274 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:25.658274 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:25.658274 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:25.658274 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:25.658274 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:25.659915 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:25.659915 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:25.659915 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:25.659915 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:25.659915 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:25.659915 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:25.659915 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:25.659915 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:25.659915 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:25.659915 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:25.659915 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:53:25.659915 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:25.659915 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:53:25.659915 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:25.659915 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 464/927] 10.222.0.49 () {56 vars in 1126 bytes} [Sun Aug 21 00:53:25 2022] GET /identity/v3/services/object-store => generated 93 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:53:25.668683 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fe85e-c896-4e54-8225-16aabab9934e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:25.688897 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885a0c5-3132-44a1-a074-169211b30c80 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:25.689416 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885a0c5-3132-44a1-a074-169211b30c80 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:25.689673 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d885a0c5-3132-44a1-a074-169211b30c80 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:25.693187 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 465/928] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:53:25.697716 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782272b8-fd32-47f3-97a5-bd0cec4e16c6 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:25.698040 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782272b8-fd32-47f3-97a5-bd0cec4e16c6 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:25.698248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-782272b8-fd32-47f3-97a5-bd0cec4e16c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:25.724738 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-782272b8-fd32-47f3-97a5-bd0cec4e16c6 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:25.727485 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-782272b8-fd32-47f3-97a5-bd0cec4e16c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:25.795381 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:25.859295 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f3fe85e-c896-4e54-8225-16aabab9934e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:25.871456 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 466/929] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 175 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:53:25.872866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31496cb7-7fe8-4459-bb4d-820fb6f1ef43 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:25.873203 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31496cb7-7fe8-4459-bb4d-820fb6f1ef43 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:25.873483 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31496cb7-7fe8-4459-bb4d-820fb6f1ef43 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:25.877558 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 467/930] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:25 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:25.883285 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de7dc8-2949-4d92-a098-817401c3f295 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:25.886059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de7dc8-2949-4d92-a098-817401c3f295 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:25.886059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2de7dc8-2949-4d92-a098-817401c3f295 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:25.912763 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-b2de7dc8-2949-4d92-a098-817401c3f295 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:25.914833 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b2de7dc8-2949-4d92-a098-817401c3f295 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:25.920260 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61495ac5-0933-44e1-9a8a-87c68930f8ad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:25.920893 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61495ac5-0933-44e1-9a8a-87c68930f8ad None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:25.921224 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61495ac5-0933-44e1-9a8a-87c68930f8ad None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:25.921488 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-61495ac5-0933-44e1-9a8a-87c68930f8ad None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:25.922132 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61495ac5-0933-44e1-9a8a-87c68930f8ad None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:25.922418 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61495ac5-0933-44e1-9a8a-87c68930f8ad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:25.923846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-61495ac5-0933-44e1-9a8a-87c68930f8ad None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:25.934383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 464/931] 10.222.0.49 () {56 vars in 1122 bytes} [Sun Aug 21 00:53:25 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:25.940845 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61495ac5-0933-44e1-9a8a-87c68930f8ad None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:26.023214 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:26.044807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 468/932] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:25 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:53:26.067348 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-61495ac5-0933-44e1-9a8a-87c68930f8ad None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:26.107694 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27768363-728b-46b9-a139-0be990cb7ee6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:26.108593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27768363-728b-46b9-a139-0be990cb7ee6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:26.109021 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27768363-728b-46b9-a139-0be990cb7ee6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:26.109489 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-27768363-728b-46b9-a139-0be990cb7ee6 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:26.110305 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27768363-728b-46b9-a139-0be990cb7ee6 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:26.110784 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27768363-728b-46b9-a139-0be990cb7ee6 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:26.112468 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-27768363-728b-46b9-a139-0be990cb7ee6 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:26.114267 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:26.120373 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 465/933] 10.222.0.49 () {56 vars in 1122 bytes} [Sun Aug 21 00:53:25 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:26.127536 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de7dc8-2949-4d92-a098-817401c3f295 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:26.286748 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2de7dc8-2949-4d92-a098-817401c3f295 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:26.330346 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4964b-73d3-41bf-97a4-85acfb9f0364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:26.330983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4964b-73d3-41bf-97a4-85acfb9f0364 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:26.331257 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4964b-73d3-41bf-97a4-85acfb9f0364 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:26.331709 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-35d4964b-73d3-41bf-97a4-85acfb9f0364 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:26.332445 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4964b-73d3-41bf-97a4-85acfb9f0364 None admin] RBAC: Adding query filter params (interface=public, service_id=714a3f5afb6d4164a89dd71bedcc0951, region_id=RegionOne) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:26.332758 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4964b-73d3-41bf-97a4-85acfb9f0364 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:26.334203 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-35d4964b-73d3-41bf-97a4-85acfb9f0364 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:26.340888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 469/934] 10.222.0.49 () {56 vars in 1251 bytes} [Sun Aug 21 00:53:26 2022] GET /identity/v3/endpoints?service_id=714a3f5afb6d4164a89dd71bedcc0951&interface=public®ion_id=RegionOne => generated 194 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:26.347249 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27768363-728b-46b9-a139-0be990cb7ee6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:26.359538 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4964b-73d3-41bf-97a4-85acfb9f0364 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:26.428470 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:26.499508 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-35d4964b-73d3-41bf-97a4-85acfb9f0364 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:26.539862 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-27768363-728b-46b9-a139-0be990cb7ee6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:26.555948 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decee3ae-7ba7-496a-803f-45f97a02ba1a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:26.556608 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decee3ae-7ba7-496a-803f-45f97a02ba1a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:26.556886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decee3ae-7ba7-496a-803f-45f97a02ba1a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:26.557192 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-decee3ae-7ba7-496a-803f-45f97a02ba1a None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:26.570342 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-decee3ae-7ba7-496a-803f-45f97a02ba1a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:53:26.575317 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-decee3ae-7ba7-496a-803f-45f97a02ba1a None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:53:26.575317 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:26.575317 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:26.575317 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:26.575317 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:26.575317 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:26.575317 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:26.575317 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:26.575317 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:26.575317 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:26.575317 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:26.575317 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:26.575317 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:53:26.575317 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:53:26.575317 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:53:26.575317 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:53:26.577242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:53:26.577242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:53:26.577242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:53:26.577242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:53:26.577242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:26.577242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:26.577242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:26.577242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:26.577242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:26.577242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:26.577242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:26.577242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:26.577242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:26.577242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:26.577242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:26.577242 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:26.579768 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:26.579768 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:26.579768 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:26.579768 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:26.579768 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:53:26.579768 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:53:26.579768 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:53:26.579768 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:53:26.579768 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:53:26.579768 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:53:26.579768 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:53:26.579768 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:26.579768 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 470/935] 10.222.0.49 () {56 vars in 1120 bytes} [Sun Aug 21 00:53:26 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 218 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:53:26.579768 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decee3ae-7ba7-496a-803f-45f97a02ba1a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:26.603120 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3c4a8-f2d3-4d7b-8f41-2e65b556dcc2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:26.603763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3c4a8-f2d3-4d7b-8f41-2e65b556dcc2 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:26.604043 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3c4a8-f2d3-4d7b-8f41-2e65b556dcc2 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:26.604317 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ef3c4a8-f2d3-4d7b-8f41-2e65b556dcc2 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:26.605110 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef3c4a8-f2d3-4d7b-8f41-2e65b556dcc2 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:26.606748 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ef3c4a8-f2d3-4d7b-8f41-2e65b556dcc2 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:26.616475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 466/936] 10.222.0.49 () {56 vars in 1087 bytes} [Sun Aug 21 00:53:26 2022] GET /identity/v3/services => generated 1497 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 00:53:26.618025 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3c4a8-f2d3-4d7b-8f41-2e65b556dcc2 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:26.761451 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:26.788055 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-decee3ae-7ba7-496a-803f-45f97a02ba1a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:26.812835 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:26.815776 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ef3c4a8-f2d3-4d7b-8f41-2e65b556dcc2 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:26.848569 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234bd9b-b6f8-4f14-b311-05177ff0f3e9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:26.848569 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234bd9b-b6f8-4f14-b311-05177ff0f3e9 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:26.848569 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234bd9b-b6f8-4f14-b311-05177ff0f3e9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:26.848569 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e234bd9b-b6f8-4f14-b311-05177ff0f3e9 None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:26.849532 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234bd9b-b6f8-4f14-b311-05177ff0f3e9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:26.851588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e234bd9b-b6f8-4f14-b311-05177ff0f3e9 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:26.853477 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: WARNING keystone.server.flask.common [None req-e234bd9b-b6f8-4f14-b311-05177ff0f3e9 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 21 00:53:26.875819 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.sql.core [None req-e234bd9b-b6f8-4f14-b311-05177ff0f3e9 None admin] Conflict project: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 21 00:53:26.875819 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 21 00:53:26.875819 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [parameters: {'id': '47b9bb13097645aea4741008239fd545', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 21 00:53:26.875819 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81578) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 21 00:53:26.879190 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333ea00-e902-455e-9113-dd23e1384255 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:26.880466 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333ea00-e902-455e-9113-dd23e1384255 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:26.881029 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333ea00-e902-455e-9113-dd23e1384255 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:26.881711 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6333ea00-e902-455e-9113-dd23e1384255 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:26.883025 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333ea00-e902-455e-9113-dd23e1384255 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:26.883756 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333ea00-e902-455e-9113-dd23e1384255 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:26.884036 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-e234bd9b-b6f8-4f14-b311-05177ff0f3e9 None admin] Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 47b9bb13097645aea4741008239fd545.: keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 47b9bb13097645aea4741008239fd545. Aug 21 00:53:26.884036 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:26.884036 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 00:53:26.884036 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 21 00:53:26.884036 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 00:53:26.884036 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 21 00:53:26.884036 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 00:53:26.884036 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application result = self._query(query) Aug 21 00:53:26.884036 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 00:53:26.884036 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application conn.query(q) Aug 21 00:53:26.884036 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 00:53:26.884036 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 00:53:26.884036 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 00:53:26.885700 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application result.read() Aug 21 00:53:26.885700 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 00:53:26.885700 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 21 00:53:26.885700 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 00:53:26.885700 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 21 00:53:26.885700 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 00:53:26.885700 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 21 00:53:26.885700 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 00:53:26.885700 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 21 00:53:26.885700 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 21 00:53:26.885700 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:26.885700 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 21 00:53:26.885700 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:26.885700 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:26.885700 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 21 00:53:26.885700 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 21 00:53:26.885700 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 241, in create_project Aug 21 00:53:26.885700 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return project_ref.to_dict() Aug 21 00:53:26.887962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 21 00:53:26.887962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application next(self.gen) Aug 21 00:53:26.887962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 21 00:53:26.887962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application yield resource Aug 21 00:53:26.887962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 21 00:53:26.887962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application next(self.gen) Aug 21 00:53:26.887962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 21 00:53:26.887962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self.session.rollback() Aug 21 00:53:26.887962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 00:53:26.887962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self.force_reraise() Aug 21 00:53:26.887962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 00:53:26.887962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise self.value Aug 21 00:53:26.887962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 21 00:53:26.887962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 21 00:53:26.887962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 21 00:53:26.887962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application session.commit() Aug 21 00:53:26.887962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 21 00:53:26.890212 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 21 00:53:26.890212 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 21 00:53:26.890212 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._prepare_impl() Aug 21 00:53:26.890212 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 21 00:53:26.890212 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self.session.flush() Aug 21 00:53:26.890212 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 21 00:53:26.890212 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._flush(objects) Aug 21 00:53:26.890212 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 21 00:53:26.890212 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 21 00:53:26.890212 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 21 00:53:26.890212 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application compat.raise_( Aug 21 00:53:26.890212 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 00:53:26.890212 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception Aug 21 00:53:26.890212 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 21 00:53:26.890212 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application flush_context.execute() Aug 21 00:53:26.890212 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 21 00:53:26.890212 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rec.execute(self) Aug 21 00:53:26.893417 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 21 00:53:26.893417 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 21 00:53:26.893417 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 21 00:53:26.893417 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 21 00:53:26.893417 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1097, in _emit_insert_statements Aug 21 00:53:26.893417 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application c = connection._execute_20( Aug 21 00:53:26.893417 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 21 00:53:26.893417 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 21 00:53:26.893417 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 21 00:53:26.893417 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 21 00:53:26.893417 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 21 00:53:26.893417 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 21 00:53:26.893417 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 21 00:53:26.893417 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 21 00:53:26.893417 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 21 00:53:26.900823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 21 00:53:26.900823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 00:53:26.900823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception Aug 21 00:53:26.900823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 00:53:26.900823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 21 00:53:26.900823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 00:53:26.900823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 21 00:53:26.900823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 00:53:26.900823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application result = self._query(query) Aug 21 00:53:26.900823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 00:53:26.900823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application conn.query(q) Aug 21 00:53:26.900823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 00:53:26.900823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 00:53:26.900823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 00:53:26.900823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application result.read() Aug 21 00:53:26.900823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 00:53:26.900823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 21 00:53:26.902777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 00:53:26.902777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 21 00:53:26.902777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 00:53:26.902777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 21 00:53:26.902777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 00:53:26.902777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 21 00:53:26.902777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-service' for key 'project.ixu_project_name_domain_id'") Aug 21 00:53:26.902777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [SQL: INSERT INTO project (id, name, domain_id, description, enabled, extra, parent_id, is_domain) VALUES (%(id)s, %(name)s, %(domain_id)s, %(description)s, %(enabled)s, %(extra)s, %(parent_id)s, %(is_domain)s)] Aug 21 00:53:26.902777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [parameters: {'id': '47b9bb13097645aea4741008239fd545', 'name': 'service', 'domain_id': 'default', 'description': '', 'enabled': 1, 'extra': '{}', 'parent_id': 'default', 'is_domain': 0}] Aug 21 00:53:26.902777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 21 00:53:26.902777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:26.902777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:53:26.902777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:26.902777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:26.902777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 216, in create_project Aug 21 00:53:26.904606 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ret = self.driver.create_project(project_id, project) Aug 21 00:53:26.904606 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 21 00:53:26.904606 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 21 00:53:26.904606 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - Duplicate entry found with name service at domain ID default. Aug 21 00:53:26.904606 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:26.904606 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:53:26.904606 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:26.904606 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:26.904606 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:26.904606 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:26.904606 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:26.904606 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:26.904606 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:26.904606 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:26.904606 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:26.904606 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:26.904606 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:26.907141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:26.907141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 176, in post Aug 21 00:53:26.907141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.resource_api.create_project( Aug 21 00:53:26.907141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:26.907141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:26.907141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 218, in create_project Aug 21 00:53:26.907141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.Conflict( Aug 21 00:53:26.907141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store project - it is not permitted to have two projects with either the same name or same id in the same domain: name is service, project id 47b9bb13097645aea4741008239fd545. Aug 21 00:53:26.907141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:26.907141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 471/937] 10.222.0.49 () {60 vars in 1140 bytes} [Sun Aug 21 00:53:26 2022] POST /identity/v3/projects => generated 262 bytes in 309 msecs (HTTP/1.1 409) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:26.908933 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6333ea00-e902-455e-9113-dd23e1384255 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:26.909179 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234bd9b-b6f8-4f14-b311-05177ff0f3e9 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:26.919207 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 467/938] 10.222.0.49 () {56 vars in 1115 bytes} [Sun Aug 21 00:53:26 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:26.931170 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333ea00-e902-455e-9113-dd23e1384255 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:27.092888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e234bd9b-b6f8-4f14-b311-05177ff0f3e9 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:27.133625 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6333ea00-e902-455e-9113-dd23e1384255 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:27.150831 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24d3ab-ad0f-4742-b1d7-332954737e40 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:27.152251 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24d3ab-ad0f-4742-b1d7-332954737e40 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:27.152877 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24d3ab-ad0f-4742-b1d7-332954737e40 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:27.153529 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4c24d3ab-ad0f-4742-b1d7-332954737e40 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:27.166351 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24d3ab-ad0f-4742-b1d7-332954737e40 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:27.169637 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4c24d3ab-ad0f-4742-b1d7-332954737e40 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:27.185404 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:27.191108 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-4c24d3ab-ad0f-4742-b1d7-332954737e40 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:27.191108 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:27.191108 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:27.191108 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:27.191108 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:27.191108 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:27.191108 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:27.191108 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:27.191108 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:27.191108 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:27.191108 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:27.191108 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:27.191108 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:53:27.191108 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:53:27.191108 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:53:27.192761 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:53:27.192761 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:27.192761 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:27.192761 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:27.192761 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:27.192761 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:27.192761 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:27.192761 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:27.192761 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:27.192761 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:27.192761 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:27.192761 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:27.192761 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:27.192761 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:27.192761 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:27.192761 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:27.192761 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:27.194448 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:53:27.194448 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:53:27.194448 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:53:27.194448 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:53:27.194448 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:53:27.194448 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:53:27.194448 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:27.194448 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:27.197407 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 472/939] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:53:26 2022] GET /identity/v3/projects/service => generated 88 bytes in 296 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:27.205582 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24d3ab-ad0f-4742-b1d7-332954737e40 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:27.219525 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78244395-b919-4c5b-a5d3-b462b46c5132 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:27.220873 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78244395-b919-4c5b-a5d3-b462b46c5132 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:27.221491 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78244395-b919-4c5b-a5d3-b462b46c5132 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:27.221957 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78244395-b919-4c5b-a5d3-b462b46c5132 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:27.252362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78244395-b919-4c5b-a5d3-b462b46c5132 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:27.254665 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78244395-b919-4c5b-a5d3-b462b46c5132 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:27.278532 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:27.283823 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-78244395-b919-4c5b-a5d3-b462b46c5132 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:27.283823 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:27.283823 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:27.283823 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:27.283823 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:27.283823 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:27.283823 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:27.283823 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:27.283823 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:27.283823 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:27.283823 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:27.283823 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:27.283823 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:27.283823 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:27.283823 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:27.283823 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:27.285824 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:27.285824 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:27.285824 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:27.285824 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:27.285824 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:27.285824 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:27.285824 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:27.285824 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:27.285824 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:27.285824 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:27.285824 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:27.285824 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:27.285824 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:27.285824 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:27.285824 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:27.285824 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:27.285824 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:27.287852 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:27.287852 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:27.287852 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:27.295533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 468/940] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:26 2022] GET /identity/v3/domains/Default => generated 87 bytes in 360 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:27.303769 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78244395-b919-4c5b-a5d3-b462b46c5132 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:27.438851 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4c24d3ab-ad0f-4742-b1d7-332954737e40 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:27.511064 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78244395-b919-4c5b-a5d3-b462b46c5132 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:27.522934 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0fcc4-7998-4db6-bcec-2fcac9c5b5d1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:27.524076 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0fcc4-7998-4db6-bcec-2fcac9c5b5d1 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:27.524804 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0fcc4-7998-4db6-bcec-2fcac9c5b5d1 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:27.525511 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45d0fcc4-7998-4db6-bcec-2fcac9c5b5d1 None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:27.526960 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0fcc4-7998-4db6-bcec-2fcac9c5b5d1 None admin] RBAC: Adding query filter params (name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:27.527636 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0fcc4-7998-4db6-bcec-2fcac9c5b5d1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:27.530672 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45d0fcc4-7998-4db6-bcec-2fcac9c5b5d1 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:27.567544 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c448063-589f-4086-a9bd-1f0da4ac6a2c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:27.568431 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c448063-589f-4086-a9bd-1f0da4ac6a2c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:27.568852 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c448063-589f-4086-a9bd-1f0da4ac6a2c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:27.569293 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c448063-589f-4086-a9bd-1f0da4ac6a2c None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:27.570100 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c448063-589f-4086-a9bd-1f0da4ac6a2c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:27.570577 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c448063-589f-4086-a9bd-1f0da4ac6a2c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:27.572136 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c448063-589f-4086-a9bd-1f0da4ac6a2c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:27.577810 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 473/941] 10.222.0.49 () {56 vars in 1112 bytes} [Sun Aug 21 00:53:27 2022] GET /identity/v3/projects?name=service => generated 411 bytes in 373 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:27.587609 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 469/942] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:27.594061 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0fcc4-7998-4db6-bcec-2fcac9c5b5d1 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:27.712738 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:27.725601 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45d0fcc4-7998-4db6-bcec-2fcac9c5b5d1 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:27.770589 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da763e-3aa6-4748-a838-86d06ff434ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:27.771539 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da763e-3aa6-4748-a838-86d06ff434ee None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:27.771969 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da763e-3aa6-4748-a838-86d06ff434ee None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:27.772419 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78da763e-3aa6-4748-a838-86d06ff434ee None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:27.782645 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da763e-3aa6-4748-a838-86d06ff434ee None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:27.785022 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78da763e-3aa6-4748-a838-86d06ff434ee None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:27.809939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-78da763e-3aa6-4748-a838-86d06ff434ee None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:53:27.809939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:27.809939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:27.809939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:27.809939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:27.809939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:27.809939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:27.809939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:27.809939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:27.809939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:27.809939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:27.809939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:27.809939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:53:27.809939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:53:27.809939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:53:27.809939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:53:27.811643 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:27.811643 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:27.811643 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:53:27.811643 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:27.811643 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:53:27.811643 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:27.811643 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:27.811643 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:27.811643 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:27.811643 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:27.811643 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:27.811643 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:27.811643 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:27.811643 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:27.811643 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:27.811643 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:27.811643 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:27.811643 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:27.814026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:27.814026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:27.814026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:53:27.814026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:53:27.814026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:53:27.814026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:53:27.814026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:53:27.814026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:53:27.814026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:53:27.814026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:27.817739 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 474/943] 10.222.0.49 () {56 vars in 1117 bytes} [Sun Aug 21 00:53:27 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 224 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:53:27.827393 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c448063-589f-4086-a9bd-1f0da4ac6a2c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:27.891385 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:27.985495 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c448063-589f-4086-a9bd-1f0da4ac6a2c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:28.057017 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727fad6-e015-4b8c-b84c-685b1e93c639 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:28.058894 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727fad6-e015-4b8c-b84c-685b1e93c639 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:28.059714 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727fad6-e015-4b8c-b84c-685b1e93c639 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:28.060520 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727fad6-e015-4b8c-b84c-685b1e93c639 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:28.062314 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727fad6-e015-4b8c-b84c-685b1e93c639 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:28.063186 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727fad6-e015-4b8c-b84c-685b1e93c639 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:28.066483 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727fad6-e015-4b8c-b84c-685b1e93c639 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:28.106221 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 470/944] 10.222.0.49 () {56 vars in 1149 bytes} [Sun Aug 21 00:53:27 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:28.111744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da763e-3aa6-4748-a838-86d06ff434ee None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:28.238139 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78da763e-3aa6-4748-a838-86d06ff434ee None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:28.280698 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5d77b-44da-45a2-a63b-1d298e43bbaf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:28.281401 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5d77b-44da-45a2-a63b-1d298e43bbaf None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:28.281679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5d77b-44da-45a2-a63b-1d298e43bbaf None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:28.281952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ca5d77b-44da-45a2-a63b-1d298e43bbaf None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:28.295792 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5d77b-44da-45a2-a63b-1d298e43bbaf None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:28.297428 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ca5d77b-44da-45a2-a63b-1d298e43bbaf None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:28.317284 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-8ca5d77b-44da-45a2-a63b-1d298e43bbaf None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:28.317284 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:28.317284 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:28.317284 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:28.317284 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:28.317284 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:28.317284 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:28.317284 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:28.317284 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:28.317284 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:28.317284 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:28.317284 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:28.317284 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:28.317284 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:28.317284 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:28.317284 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:28.319425 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:28.319425 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:28.319425 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:28.319425 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:28.319425 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:28.319425 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:28.319425 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:28.319425 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:28.319425 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:28.319425 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:28.319425 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:28.319425 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:28.319425 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:28.319425 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:28.319425 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:28.319425 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:28.319425 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:28.321531 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:28.321531 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:28.321531 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:28.321531 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 475/945] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:28 2022] GET /identity/v3/domains/Default => generated 87 bytes in 208 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:28.326284 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727fad6-e015-4b8c-b84c-685b1e93c639 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:28.481608 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:28.490628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727fad6-e015-4b8c-b84c-685b1e93c639 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:28.558669 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b870dd38-fd86-4b88-b124-2f6b7f76369e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:28.559715 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870dd38-fd86-4b88-b124-2f6b7f76369e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:28.560201 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870dd38-fd86-4b88-b124-2f6b7f76369e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:28.560678 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b870dd38-fd86-4b88-b124-2f6b7f76369e None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:28.561931 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870dd38-fd86-4b88-b124-2f6b7f76369e None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:28.562468 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870dd38-fd86-4b88-b124-2f6b7f76369e None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:28.565163 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b870dd38-fd86-4b88-b124-2f6b7f76369e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:28.589545 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 471/946] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:28 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 264 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:28.595021 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5d77b-44da-45a2-a63b-1d298e43bbaf None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:28.599887 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:28.770557 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ca5d77b-44da-45a2-a63b-1d298e43bbaf None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:28.784765 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1c1d2-7f34-41b3-879d-90265ae96496 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:28.785830 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1c1d2-7f34-41b3-879d-90265ae96496 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:28.787117 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08e1c1d2-7f34-41b3-879d-90265ae96496 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:28.797272 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 472/947] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:28 2022] GET /identity => generated 270 bytes in 15 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:53:28.799523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9516b-7ff2-4ce5-badc-31178bbb54a3 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:28.799960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9516b-7ff2-4ce5-badc-31178bbb54a3 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:28.800429 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bd9516b-7ff2-4ce5-badc-31178bbb54a3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:28.835114 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-8bd9516b-7ff2-4ce5-badc-31178bbb54a3 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:28.837609 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8bd9516b-7ff2-4ce5-badc-31178bbb54a3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:28.840202 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfed4ba-b7a9-4b64-86e3-8978633ca403 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:28.841462 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfed4ba-b7a9-4b64-86e3-8978633ca403 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:28.841934 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfed4ba-b7a9-4b64-86e3-8978633ca403 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:28.842391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0bfed4ba-b7a9-4b64-86e3-8978633ca403 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:28.860807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfed4ba-b7a9-4b64-86e3-8978633ca403 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:28.863935 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0bfed4ba-b7a9-4b64-86e3-8978633ca403 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:28.886213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-0bfed4ba-b7a9-4b64-86e3-8978633ca403 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:28.886213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:28.886213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:28.886213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:28.886213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:28.886213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:28.886213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:28.886213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:28.886213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:28.886213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:28.886213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:28.886213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:28.886213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:53:28.886213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:53:28.886213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:53:28.887990 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:53:28.887990 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:28.887990 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:28.887990 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:28.887990 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:28.887990 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:28.887990 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:28.887990 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:28.887990 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:28.887990 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:28.887990 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:28.887990 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:28.887990 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:28.887990 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:28.887990 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:28.887990 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:28.887990 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:28.889738 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:53:28.889738 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:53:28.889738 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:53:28.889738 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:53:28.889738 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:53:28.889738 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:53:28.889738 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:28.889738 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:28.889738 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 476/948] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:53:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 294 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:28.900053 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfed4ba-b7a9-4b64-86e3-8978633ca403 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:28.919711 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 473/949] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:28 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 122 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:29.030403 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:29.113476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0bfed4ba-b7a9-4b64-86e3-8978633ca403 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:29.173779 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e5279-9e4f-497a-a18b-a86e23de8094 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:29.174625 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e5279-9e4f-497a-a18b-a86e23de8094 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:29.174945 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e5279-9e4f-497a-a18b-a86e23de8094 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:29.175236 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d6e5279-9e4f-497a-a18b-a86e23de8094 None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:29.176059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e5279-9e4f-497a-a18b-a86e23de8094 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:29.176372 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e5279-9e4f-497a-a18b-a86e23de8094 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:29.178034 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d6e5279-9e4f-497a-a18b-a86e23de8094 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:29.193675 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 477/950] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:53:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 295 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:29.201128 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9516b-7ff2-4ce5-badc-31178bbb54a3 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:29.318069 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e5279-9e4f-497a-a18b-a86e23de8094 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:29.363453 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:29.386945 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bd9516b-7ff2-4ce5-badc-31178bbb54a3 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:29.434554 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf130c2f-6ea2-4536-a5ec-294df6fb5948 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:29.436198 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf130c2f-6ea2-4536-a5ec-294df6fb5948 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:29.436496 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf130c2f-6ea2-4536-a5ec-294df6fb5948 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:29.436749 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf130c2f-6ea2-4536-a5ec-294df6fb5948 None admin] PATH_INFO: `/v3/projects/838e996d09a0454b9bcdc5aef03ef203/users/a06f043017114f9090264293f5ede6c4/roles/bfc1c16a629c46a0883a2f7363d940cf` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:29.439621 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf130c2f-6ea2-4536-a5ec-294df6fb5948 None admin] RBAC: Authorizing `identity:create_grant(project_id=838e996d09a0454b9bcdc5aef03ef203, user_id=a06f043017114f9090264293f5ede6c4, role_id=bfc1c16a629c46a0883a2f7363d940cf)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:29.441581 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf130c2f-6ea2-4536-a5ec-294df6fb5948 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:29.472463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 474/951] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 21 00:53:29 2022] PUT /identity/v3/projects/838e996d09a0454b9bcdc5aef03ef203/users/a06f043017114f9090264293f5ede6c4/roles/bfc1c16a629c46a0883a2f7363d940cf => generated 0 bytes in 272 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 00:53:29.535230 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d6e5279-9e4f-497a-a18b-a86e23de8094 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:29.578064 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:29.591519 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b764b3ec-c0e3-4c88-9ef3-77ae0fc1cd47 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:29.592197 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764b3ec-c0e3-4c88-9ef3-77ae0fc1cd47 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:29.592523 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764b3ec-c0e3-4c88-9ef3-77ae0fc1cd47 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:29.592804 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b764b3ec-c0e3-4c88-9ef3-77ae0fc1cd47 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:29.593509 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764b3ec-c0e3-4c88-9ef3-77ae0fc1cd47 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:29.595357 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b764b3ec-c0e3-4c88-9ef3-77ae0fc1cd47 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:29.605537 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-b764b3ec-c0e3-4c88-9ef3-77ae0fc1cd47 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 00:53:29.605537 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:29.605537 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:53:29.605537 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:53:29.605537 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:53:29.605537 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:53:29.605537 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:53:29.605537 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:29.605537 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 00:53:29.605537 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:29.605537 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:53:29.605537 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:29.605537 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:29.605537 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:29.605537 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:29.605537 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:29.605537 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:29.607668 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:29.607668 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:29.607668 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:29.607668 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:29.607668 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:29.607668 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:29.607668 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:53:29.607668 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:53:29.607668 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:53:29.607668 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:53:29.607668 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:29.607668 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:29.607668 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:29.607668 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:29.607668 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:29.607668 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:29.610394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:29.610394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:29.610394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:29.610394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:29.610394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:29.610394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:29.610394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:29.610394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:29.610394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:29.610394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:29.610394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:53:29.610394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:29.610394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 00:53:29.610394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:29.610394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 478/952] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:53:29 2022] GET /identity/v3/services/compute => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:53:29.616421 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf130c2f-6ea2-4536-a5ec-294df6fb5948 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:29.803786 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fa36a-ebf6-4cb0-aef5-15b7b3b6abf9 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:29.804257 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fa36a-ebf6-4cb0-aef5-15b7b3b6abf9 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:29.804495 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da5fa36a-ebf6-4cb0-aef5-15b7b3b6abf9 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:29.806142 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 479/953] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:29.813665 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b87e1-afb7-4370-abae-c279f7ff3627 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:29.814395 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b87e1-afb7-4370-abae-c279f7ff3627 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:29.814885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b05b87e1-afb7-4370-abae-c279f7ff3627 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:29.828988 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf130c2f-6ea2-4536-a5ec-294df6fb5948 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:29.860597 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-b05b87e1-afb7-4370-abae-c279f7ff3627 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:29.864115 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b05b87e1-afb7-4370-abae-c279f7ff3627 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:29.887915 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c7dac-0ec6-46fa-bed7-edc027ce8fb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:29.889197 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c7dac-0ec6-46fa-bed7-edc027ce8fb0 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:29.889688 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c7dac-0ec6-46fa-bed7-edc027ce8fb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:29.890171 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3c7dac-0ec6-46fa-bed7-edc027ce8fb0 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:29.891552 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c7dac-0ec6-46fa-bed7-edc027ce8fb0 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:29.892215 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c7dac-0ec6-46fa-bed7-edc027ce8fb0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:29.895021 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3c7dac-0ec6-46fa-bed7-edc027ce8fb0 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:29.905917 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 475/954] 10.222.0.49 () {56 vars in 1112 bytes} [Sun Aug 21 00:53:29 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:29.915256 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c7dac-0ec6-46fa-bed7-edc027ce8fb0 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:29.940597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:30.037300 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 480/955] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:29 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:53:30.101316 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3c7dac-0ec6-46fa-bed7-edc027ce8fb0 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:30.142434 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f90378-165c-4a8a-8c10-82e71609f4d5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:30.143130 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f90378-165c-4a8a-8c10-82e71609f4d5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:30.143441 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f90378-165c-4a8a-8c10-82e71609f4d5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:30.143738 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f90378-165c-4a8a-8c10-82e71609f4d5 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:30.144344 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f90378-165c-4a8a-8c10-82e71609f4d5 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:30.144645 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f90378-165c-4a8a-8c10-82e71609f4d5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:30.146063 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21f90378-165c-4a8a-8c10-82e71609f4d5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:30.151867 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 476/956] 10.222.0.49 () {56 vars in 1112 bytes} [Sun Aug 21 00:53:29 2022] GET /identity/v3/services?type=compute => generated 124 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:30.562136 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b87e1-afb7-4370-abae-c279f7ff3627 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:30.744500 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b05b87e1-afb7-4370-abae-c279f7ff3627 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:30.781312 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:30.813146 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f711fa-28bf-459e-a679-118c88cbc9d9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:30.814097 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f711fa-28bf-459e-a679-118c88cbc9d9 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:30.814578 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f711fa-28bf-459e-a679-118c88cbc9d9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:30.815125 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1f711fa-28bf-459e-a679-118c88cbc9d9 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:30.816156 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f711fa-28bf-459e-a679-118c88cbc9d9 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:30.818601 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b1f711fa-28bf-459e-a679-118c88cbc9d9 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:30.822246 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392910a0-ca0e-4e9b-81a4-6c2f8373c9ca None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:30.823199 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392910a0-ca0e-4e9b-81a4-6c2f8373c9ca None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:30.824049 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-392910a0-ca0e-4e9b-81a4-6c2f8373c9ca None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:30.833576 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 477/957] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:30 2022] GET /identity => generated 270 bytes in 13 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:30.836244 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-b1f711fa-28bf-459e-a679-118c88cbc9d9 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:53:30.836244 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:30.836244 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:53:30.836244 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:53:30.836244 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:53:30.836244 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:53:30.836244 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:53:30.836244 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:30.836244 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:53:30.836244 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:30.836244 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:53:30.836244 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:30.836244 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:30.836244 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:30.836244 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:30.836244 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:30.836244 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:30.838240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:30.838240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:30.838240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:30.838240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:30.838240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:30.838240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:30.838240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:53:30.838240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:53:30.838240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:53:30.838240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:53:30.838240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:30.838240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:30.838240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:30.838240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:30.838240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:30.838240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:30.840050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:30.840050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:30.840050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:30.840050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:30.840050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:30.840050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:30.840050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:30.840050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:30.840050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:30.840050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:30.840050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:53:30.840050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:30.840050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:53:30.840050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:30.840050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 481/958] 10.222.0.49 () {56 vars in 1126 bytes} [Sun Aug 21 00:53:30 2022] GET /identity/v3/services/object-store => generated 93 bytes in 278 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:30.846920 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c38572-b893-4225-ac8d-8e9f225399de None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:30.847599 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c38572-b893-4225-ac8d-8e9f225399de None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:30.848249 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c38572-b893-4225-ac8d-8e9f225399de None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:30.852294 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f711fa-28bf-459e-a679-118c88cbc9d9 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:30.888560 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-41c38572-b893-4225-ac8d-8e9f225399de None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:30.891627 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-41c38572-b893-4225-ac8d-8e9f225399de None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:31.053234 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 478/959] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:30 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:31.054165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1f711fa-28bf-459e-a679-118c88cbc9d9 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:31.115575 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de04850-c845-4ff4-b694-992469fd5f5a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:31.116413 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de04850-c845-4ff4-b694-992469fd5f5a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:31.116846 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de04850-c845-4ff4-b694-992469fd5f5a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:31.117382 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1de04850-c845-4ff4-b694-992469fd5f5a None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:31.118548 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de04850-c845-4ff4-b694-992469fd5f5a None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:31.119089 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de04850-c845-4ff4-b694-992469fd5f5a None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:31.121692 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1de04850-c845-4ff4-b694-992469fd5f5a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:31.132019 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 482/960] 10.222.0.49 () {56 vars in 1122 bytes} [Sun Aug 21 00:53:30 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:31.139681 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c38572-b893-4225-ac8d-8e9f225399de None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:31.154305 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:31.292859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c38572-b893-4225-ac8d-8e9f225399de None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:31.357947 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec632297-5e99-47f5-b46e-63d556d2c6f9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:31.359506 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec632297-5e99-47f5-b46e-63d556d2c6f9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:31.360304 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec632297-5e99-47f5-b46e-63d556d2c6f9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:31.361121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec632297-5e99-47f5-b46e-63d556d2c6f9 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:31.362582 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec632297-5e99-47f5-b46e-63d556d2c6f9 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:31.363424 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec632297-5e99-47f5-b46e-63d556d2c6f9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:31.366425 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec632297-5e99-47f5-b46e-63d556d2c6f9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:31.377397 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 479/961] 10.222.0.49 () {56 vars in 1122 bytes} [Sun Aug 21 00:53:31 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 239 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:31.386916 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de04850-c845-4ff4-b694-992469fd5f5a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:31.438192 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:31.482644 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec632297-5e99-47f5-b46e-63d556d2c6f9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:31.498975 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1de04850-c845-4ff4-b694-992469fd5f5a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:31.538279 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc304dbc-0325-450a-aa89-346de2eda57e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:31.538592 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc304dbc-0325-450a-aa89-346de2eda57e None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:31.538982 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc304dbc-0325-450a-aa89-346de2eda57e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:31.539147 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cc304dbc-0325-450a-aa89-346de2eda57e None admin] PATH_INFO: `/v3/endpoints` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:31.539874 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc304dbc-0325-450a-aa89-346de2eda57e None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:31.541377 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cc304dbc-0325-450a-aa89-346de2eda57e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:31.567709 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 483/962] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 21 00:53:31 2022] POST /identity/v3/endpoints => generated 349 bytes in 185 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:53:31.624227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:31.696247 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec632297-5e99-47f5-b46e-63d556d2c6f9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:31.781444 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c8097-0256-4d73-9a6a-044c72a044d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:31.782973 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c8097-0256-4d73-9a6a-044c72a044d8 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:31.783753 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c8097-0256-4d73-9a6a-044c72a044d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:31.784504 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-724c8097-0256-4d73-9a6a-044c72a044d8 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:31.786014 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c8097-0256-4d73-9a6a-044c72a044d8 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:31.789312 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-724c8097-0256-4d73-9a6a-044c72a044d8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:31.794331 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: WARNING keystone.server.flask.common [None req-724c8097-0256-4d73-9a6a-044c72a044d8 None admin] Deprecated: Not specifying a domain during a create user, group or project call, and relying on falling back to the default domain, is deprecated as of Liberty. There is no plan to remove this compatibility, however, future API versions may remove this, so please specify the domain explicitly or use a domain-scoped token. Aug 21 00:53:31.815733 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.sql.core [None req-724c8097-0256-4d73-9a6a-044c72a044d8 None admin] Conflict user: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 21 00:53:31.815733 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 21 00:53:31.815733 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [parameters: {'user_id': '36a98835369a4e9c9ced520ede2e173e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 21 00:53:31.815733 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: (Background on this error at: https://sqlalche.me/e/14/gkpj) {{(pid=81577) wrapper /opt/stack/keystone/keystone/common/sql/core.py:533}} Aug 21 00:53:31.846266 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-724c8097-0256-4d73-9a6a-044c72a044d8 None admin] Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default.: keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 21 00:53:31.846266 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:31.846266 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 00:53:31.846266 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 21 00:53:31.846266 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 00:53:31.846266 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 21 00:53:31.846266 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 00:53:31.846266 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application result = self._query(query) Aug 21 00:53:31.846266 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 00:53:31.846266 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application conn.query(q) Aug 21 00:53:31.846266 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 00:53:31.846266 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 00:53:31.846266 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 00:53:31.846266 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application result.read() Aug 21 00:53:31.846266 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 00:53:31.847383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 21 00:53:31.847383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 00:53:31.847383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 21 00:53:31.847383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 00:53:31.847383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 21 00:53:31.847383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 00:53:31.847383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 21 00:53:31.847383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application pymysql.err.IntegrityError: (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 21 00:53:31.847383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:31.847383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application The above exception was the direct cause of the following exception: Aug 21 00:53:31.847383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:31.847383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:31.847383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 528, in wrapper Aug 21 00:53:31.847383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return method(*args, **kwargs) Aug 21 00:53:31.847383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 141, in create_user Aug 21 00:53:31.847383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return base.filter_user(user_ref.to_dict()) Aug 21 00:53:31.847383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 21 00:53:31.847383 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application next(self.gen) Aug 21 00:53:31.848853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 1060, in _transaction_scope Aug 21 00:53:31.848853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application yield resource Aug 21 00:53:31.848853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ Aug 21 00:53:31.848853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application next(self.gen) Aug 21 00:53:31.848853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 662, in _session Aug 21 00:53:31.848853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self.session.rollback() Aug 21 00:53:31.848853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 227, in __exit__ Aug 21 00:53:31.848853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self.force_reraise() Aug 21 00:53:31.848853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_utils/excutils.py", line 200, in force_reraise Aug 21 00:53:31.848853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise self.value Aug 21 00:53:31.848853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 659, in _session Aug 21 00:53:31.848853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._end_session_transaction(self.session) Aug 21 00:53:31.848853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/enginefacade.py", line 687, in _end_session_transaction Aug 21 00:53:31.848853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application session.commit() Aug 21 00:53:31.848853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 1451, in commit Aug 21 00:53:31.848853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._transaction.commit(_to_root=self.future) Aug 21 00:53:31.848853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 829, in commit Aug 21 00:53:31.850893 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._prepare_impl() Aug 21 00:53:31.850893 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 808, in _prepare_impl Aug 21 00:53:31.850893 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self.session.flush() Aug 21 00:53:31.850893 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3383, in flush Aug 21 00:53:31.850893 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._flush(objects) Aug 21 00:53:31.850893 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3523, in _flush Aug 21 00:53:31.850893 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application transaction.rollback(_capture_exception=True) Aug 21 00:53:31.850893 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/langhelpers.py", line 70, in __exit__ Aug 21 00:53:31.850893 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application compat.raise_( Aug 21 00:53:31.850893 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 00:53:31.850893 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception Aug 21 00:53:31.850893 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/session.py", line 3483, in _flush Aug 21 00:53:31.850893 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application flush_context.execute() Aug 21 00:53:31.850893 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 456, in execute Aug 21 00:53:31.850893 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rec.execute(self) Aug 21 00:53:31.850893 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/unitofwork.py", line 630, in execute Aug 21 00:53:31.850893 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application util.preloaded.orm_persistence.save_obj( Aug 21 00:53:31.853030 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 245, in save_obj Aug 21 00:53:31.853030 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application _emit_insert_statements( Aug 21 00:53:31.853030 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/orm/persistence.py", line 1238, in _emit_insert_statements Aug 21 00:53:31.853030 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application result = connection._execute_20( Aug 21 00:53:31.853030 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1705, in _execute_20 Aug 21 00:53:31.853030 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return meth(self, args_10style, kwargs_10style, execution_options) Aug 21 00:53:31.853030 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/sql/elements.py", line 333, in _execute_on_connection Aug 21 00:53:31.853030 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return connection._execute_clauseelement( Aug 21 00:53:31.853030 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1572, in _execute_clauseelement Aug 21 00:53:31.853030 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ret = self._execute_context( Aug 21 00:53:31.853030 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1943, in _execute_context Aug 21 00:53:31.853030 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._handle_dbapi_exception( Aug 21 00:53:31.853030 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 2122, in _handle_dbapi_exception Aug 21 00:53:31.853030 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application util.raise_(newraise, with_traceback=exc_info[2], from_=e) Aug 21 00:53:31.853030 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/util/compat.py", line 208, in raise_ Aug 21 00:53:31.853030 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception Aug 21 00:53:31.864841 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/base.py", line 1900, in _execute_context Aug 21 00:53:31.864841 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self.dialect.do_execute( Aug 21 00:53:31.864841 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/sqlalchemy/engine/default.py", line 732, in do_execute Aug 21 00:53:31.864841 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application cursor.execute(statement, parameters) Aug 21 00:53:31.864841 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 148, in execute Aug 21 00:53:31.864841 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application result = self._query(query) Aug 21 00:53:31.864841 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/cursors.py", line 310, in _query Aug 21 00:53:31.864841 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application conn.query(q) Aug 21 00:53:31.864841 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 548, in query Aug 21 00:53:31.864841 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._affected_rows = self._read_query_result(unbuffered=unbuffered) Aug 21 00:53:31.864841 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 775, in _read_query_result Aug 21 00:53:31.864841 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application result.read() Aug 21 00:53:31.864841 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 1156, in read Aug 21 00:53:31.864841 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application first_packet = self.connection._read_packet() Aug 21 00:53:31.864841 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/connections.py", line 725, in _read_packet Aug 21 00:53:31.864841 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application packet.raise_for_error() Aug 21 00:53:31.866644 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/protocol.py", line 221, in raise_for_error Aug 21 00:53:31.866644 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application err.raise_mysql_exception(self._data) Aug 21 00:53:31.866644 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/pymysql/err.py", line 143, in raise_mysql_exception Aug 21 00:53:31.866644 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise errorclass(errno, errval) Aug 21 00:53:31.866644 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application oslo_db.exception.DBDuplicateEntry: (pymysql.err.IntegrityError) (1062, "Duplicate entry 'default-cinder' for key 'local_user.domain_id'") Aug 21 00:53:31.866644 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [SQL: INSERT INTO local_user (user_id, domain_id, name, failed_auth_count, failed_auth_at) VALUES (%(user_id)s, %(domain_id)s, %(name)s, %(failed_auth_count)s, %(failed_auth_at)s)] Aug 21 00:53:31.866644 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [parameters: {'user_id': '36a98835369a4e9c9ced520ede2e173e', 'domain_id': 'default', 'name': 'cinder', 'failed_auth_count': 0, 'failed_auth_at': None}] Aug 21 00:53:31.866644 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application (Background on this error at: https://sqlalche.me/e/14/gkpj) Aug 21 00:53:31.866644 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:31.866644 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:53:31.866644 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:31.866644 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:31.866644 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:31.866644 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:31.866644 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:31.868268 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:31.868268 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:31.868268 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:31.868268 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:31.868268 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:31.868268 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:31.868268 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:31.868268 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 244, in post Aug 21 00:53:31.868268 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.create_user( Aug 21 00:53:31.868268 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:31.868268 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:31.868268 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:53:31.868268 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:31.868268 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:53:31.868268 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:31.868268 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1000, in create_user Aug 21 00:53:31.868268 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = self._create_user_with_federated_objects(user, driver) Aug 21 00:53:31.870284 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 966, in _create_user_with_federated_objects Aug 21 00:53:31.870284 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application user = driver.create_user(user['id'], user) Aug 21 00:53:31.870284 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/sql/core.py", line 563, in wrapper Aug 21 00:53:31.870284 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.Conflict(type=conflict_type, Aug 21 00:53:31.870284 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.Conflict: Conflict occurred attempting to store user - Duplicate entry found with name cinder at domain ID default. Aug 21 00:53:31.870284 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:31.870284 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 480/963] 10.222.0.49 () {60 vars in 1131 bytes} [Sun Aug 21 00:53:31 2022] POST /identity/v3/users => generated 160 bytes in 367 msecs (HTTP/1.1 409) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:53:31.871078 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc304dbc-0325-450a-aa89-346de2eda57e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:32.070078 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cc304dbc-0325-450a-aa89-346de2eda57e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:32.073607 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:32.138399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-036e8855-8f79-4098-9fe3-e0b96771e9e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:32.139876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e8855-8f79-4098-9fe3-e0b96771e9e1 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:32.140650 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e8855-8f79-4098-9fe3-e0b96771e9e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:32.141415 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-036e8855-8f79-4098-9fe3-e0b96771e9e1 None admin] PATH_INFO: `/v3/users/cinder` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:32.157076 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e8855-8f79-4098-9fe3-e0b96771e9e1 None admin] RBAC: Authorizing `identity:get_user(user_id=cinder)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:32.160390 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-036e8855-8f79-4098-9fe3-e0b96771e9e1 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:32.184566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-036e8855-8f79-4098-9fe3-e0b96771e9e1 None admin] Could not find user: cinder.: keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 00:53:32.184566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:32.184566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:32.184566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:32.184566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:32.184566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:32.184566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:32.184566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:32.184566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:32.184566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:32.184566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:32.184566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:32.184566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:53:32.184566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:53:32.184566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:53:32.184566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:53:32.186473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:32.186473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:32.186473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:53:32.186473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:32.186473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:53:32.186473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:32.186473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:32.186473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:32.186473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:32.186473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:32.186473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:32.186473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:32.186473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:32.186473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:32.186473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:32.186473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:32.186473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:32.186473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:32.188370 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:32.188370 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:32.188370 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:53:32.188370 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:53:32.188370 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:53:32.188370 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:53:32.188370 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:53:32.188370 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:53:32.188370 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: cinder. Aug 21 00:53:32.188370 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:32.197248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 484/964] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:53:31 2022] GET /identity/v3/users/cinder => generated 84 bytes in 334 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:32.202995 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c8097-0256-4d73-9a6a-044c72a044d8 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:32.411484 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-724c8097-0256-4d73-9a6a-044c72a044d8 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:32.461665 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=98,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:32.484377 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f98b97-896e-4310-9a88-9704ebd86f3c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:32.485481 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f98b97-896e-4310-9a88-9704ebd86f3c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:32.485993 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f98b97-896e-4310-9a88-9704ebd86f3c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:32.486483 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3f98b97-896e-4310-9a88-9704ebd86f3c None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:32.487505 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f98b97-896e-4310-9a88-9704ebd86f3c None admin] RBAC: Adding query filter params (name=cinder) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:32.488035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f98b97-896e-4310-9a88-9704ebd86f3c None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:32.489986 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3f98b97-896e-4310-9a88-9704ebd86f3c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:32.492740 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6e70e-fdc5-4de4-a89b-e33bfd31b7a3 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:32.493034 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6e70e-fdc5-4de4-a89b-e33bfd31b7a3 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:32.493334 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a6e70e-fdc5-4de4-a89b-e33bfd31b7a3 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:32.495062 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 485/965] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:53:32.500899 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb14d1-bc9e-4269-a832-c13b2c10af0c None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:32.501218 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb14d1-bc9e-4269-a832-c13b2c10af0c None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:32.501478 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2cdb14d1-bc9e-4269-a832-c13b2c10af0c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:32.529990 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-2cdb14d1-bc9e-4269-a832-c13b2c10af0c None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:32.534234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-2cdb14d1-bc9e-4269-a832-c13b2c10af0c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:32.572659 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 481/966] 10.222.0.49 () {56 vars in 1101 bytes} [Sun Aug 21 00:53:32 2022] GET /identity/v3/users?name=cinder => generated 354 bytes in 371 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:32.641730 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 486/967] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:32 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:53:32.965011 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f98b97-896e-4310-9a88-9704ebd86f3c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:33.118931 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3f98b97-896e-4310-9a88-9704ebd86f3c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:33.134910 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab942f-38c1-4e24-bf25-1811ae5650e9 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:33.135191 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab942f-38c1-4e24-bf25-1811ae5650e9 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:33.135466 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-04ab942f-38c1-4e24-bf25-1811ae5650e9 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:33.136894 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 487/968] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:33.143320 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380965b-cb76-41f0-bd6c-0a9d888e34a7 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:33.143755 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380965b-cb76-41f0-bd6c-0a9d888e34a7 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:33.144057 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5380965b-cb76-41f0-bd6c-0a9d888e34a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:33.173971 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-5380965b-cb76-41f0-bd6c-0a9d888e34a7 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:33.176672 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5380965b-cb76-41f0-bd6c-0a9d888e34a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:33.176899 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d26f01-7893-4f02-81ab-2c9f2829e05f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:33.177688 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d26f01-7893-4f02-81ab-2c9f2829e05f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:33.177963 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d26f01-7893-4f02-81ab-2c9f2829e05f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:33.178309 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98d26f01-7893-4f02-81ab-2c9f2829e05f None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:33.200020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98d26f01-7893-4f02-81ab-2c9f2829e05f None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:53:33.205586 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-98d26f01-7893-4f02-81ab-2c9f2829e05f None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:53:33.205586 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:33.205586 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:33.205586 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:33.205586 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:33.205586 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:33.205586 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:33.205586 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:33.205586 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:33.205586 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:33.205586 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:33.205586 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:33.205586 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:53:33.205586 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:53:33.205586 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:53:33.205586 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:53:33.208121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:53:33.208121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:53:33.208121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:53:33.208121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:53:33.208121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:33.208121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:33.208121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:33.208121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:33.208121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:33.208121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:33.208121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:33.208121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:33.208121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:33.208121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:33.208121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:33.208121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:33.209448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:33.209448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:33.209448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:33.209448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:33.209448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:53:33.209448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:53:33.209448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:53:33.209448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:53:33.209448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:53:33.209448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:53:33.209448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:53:33.209448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:33.209448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 482/969] 10.222.0.49 () {56 vars in 1120 bytes} [Sun Aug 21 00:53:32 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:33.214925 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d26f01-7893-4f02-81ab-2c9f2829e05f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:33.283039 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:33.312146 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 488/970] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:33 2022] POST /identity/v3/auth/tokens => generated 1474 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:53:33.391535 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98d26f01-7893-4f02-81ab-2c9f2829e05f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:33.460936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050fdc5-3231-4cff-bf08-23c31726e674 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:33.462009 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050fdc5-3231-4cff-bf08-23c31726e674 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:33.466489 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050fdc5-3231-4cff-bf08-23c31726e674 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:33.466489 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3050fdc5-3231-4cff-bf08-23c31726e674 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:33.466489 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050fdc5-3231-4cff-bf08-23c31726e674 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:33.466489 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050fdc5-3231-4cff-bf08-23c31726e674 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:33.467449 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3050fdc5-3231-4cff-bf08-23c31726e674 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:33.483876 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 483/971] 10.222.0.49 () {56 vars in 1115 bytes} [Sun Aug 21 00:53:33 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 270 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:33.492751 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380965b-cb76-41f0-bd6c-0a9d888e34a7 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:33.538911 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:33.655011 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5380965b-cb76-41f0-bd6c-0a9d888e34a7 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:33.697436 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5a47b-fa7b-4abd-931d-f83d39b02ede None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:33.698153 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5a47b-fa7b-4abd-931d-f83d39b02ede None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:33.698581 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5a47b-fa7b-4abd-931d-f83d39b02ede None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:33.698856 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78e5a47b-fa7b-4abd-931d-f83d39b02ede None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:33.711636 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5a47b-fa7b-4abd-931d-f83d39b02ede None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:33.713380 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78e5a47b-fa7b-4abd-931d-f83d39b02ede None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:33.732062 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-78e5a47b-fa7b-4abd-931d-f83d39b02ede None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:33.732062 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:33.732062 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:33.732062 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:33.732062 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:33.732062 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:33.732062 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:33.732062 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:33.732062 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:33.732062 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:33.732062 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:33.732062 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:33.732062 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:33.732062 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:33.732062 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:33.732062 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:33.734083 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:33.734083 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:33.734083 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:33.734083 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:33.734083 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:33.734083 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:33.734083 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:33.734083 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:33.734083 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:33.734083 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:33.734083 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:33.734083 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:33.734083 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:33.734083 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:33.734083 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:33.734083 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:33.734083 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:33.735573 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:33.735573 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:33.735573 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:33.735573 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 489/972] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 243 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:33.742652 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050fdc5-3231-4cff-bf08-23c31726e674 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:33.748926 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5a47b-fa7b-4abd-931d-f83d39b02ede None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:33.867763 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:33.903786 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3050fdc5-3231-4cff-bf08-23c31726e674 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:33.907534 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:33.913733 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78e5a47b-fa7b-4abd-931d-f83d39b02ede None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:33.957076 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90191a45-b031-4d1e-96da-577e89b4ae77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:33.958245 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90191a45-b031-4d1e-96da-577e89b4ae77 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:33.958739 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90191a45-b031-4d1e-96da-577e89b4ae77 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:33.959225 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90191a45-b031-4d1e-96da-577e89b4ae77 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:33.960827 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90191a45-b031-4d1e-96da-577e89b4ae77 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:33.960986 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90191a45-b031-4d1e-96da-577e89b4ae77 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:33.963666 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90191a45-b031-4d1e-96da-577e89b4ae77 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:33.982513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b737b4-b710-4d38-bad6-959fe26aa41d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:33.983675 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b737b4-b710-4d38-bad6-959fe26aa41d None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:33.984179 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b737b4-b710-4d38-bad6-959fe26aa41d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:33.984625 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c2b737b4-b710-4d38-bad6-959fe26aa41d None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:33.985852 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b737b4-b710-4d38-bad6-959fe26aa41d None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:33.992308 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 484/973] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:33.992559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c2b737b4-b710-4d38-bad6-959fe26aa41d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:33.995268 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90191a45-b031-4d1e-96da-577e89b4ae77 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:34.025106 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 490/974] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 21 00:53:33 2022] POST /identity/v3/services => generated 242 bytes in 270 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:53:34.217140 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90191a45-b031-4d1e-96da-577e89b4ae77 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:34.302443 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b912d7-9edf-447b-9dfd-27423f9d6db1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:34.303705 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b912d7-9edf-447b-9dfd-27423f9d6db1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:34.304518 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b912d7-9edf-447b-9dfd-27423f9d6db1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:34.305088 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e9b912d7-9edf-447b-9dfd-27423f9d6db1 None admin] PATH_INFO: `/v3/users/glance-swift` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:34.320441 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b912d7-9edf-447b-9dfd-27423f9d6db1 None admin] RBAC: Authorizing `identity:get_user(user_id=glance-swift)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:34.323330 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e9b912d7-9edf-447b-9dfd-27423f9d6db1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:34.348370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-e9b912d7-9edf-447b-9dfd-27423f9d6db1 None admin] Could not find user: glance-swift.: keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:53:34.348370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:34.348370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:34.348370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:34.348370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:34.348370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:34.348370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:34.348370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:34.348370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:34.348370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:34.348370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:34.348370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:34.348370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:53:34.348370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:53:34.348370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:53:34.348370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:53:34.350282 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:34.350282 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:34.350282 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:53:34.350282 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:34.350282 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:53:34.350282 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:34.350282 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:34.350282 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:34.350282 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:34.350282 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:34.350282 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:34.350282 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:34.350282 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:34.350282 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:34.350282 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:34.350282 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:34.350282 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:34.350282 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:34.352790 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:34.352790 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:34.352790 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:53:34.352790 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:53:34.352790 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:53:34.352790 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:53:34.352790 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:53:34.352790 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:53:34.352790 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: glance-swift. Aug 21 00:53:34.352790 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:34.352790 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 485/975] 10.222.0.49 () {56 vars in 1117 bytes} [Sun Aug 21 00:53:33 2022] GET /identity/v3/users/glance-swift => generated 90 bytes in 358 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:53:34.360432 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b737b4-b710-4d38-bad6-959fe26aa41d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:34.563783 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c2b737b4-b710-4d38-bad6-959fe26aa41d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:34.629535 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-88119d64-62e2-4cd6-8591-eec1cf6fa944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:34.630666 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88119d64-62e2-4cd6-8591-eec1cf6fa944 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:34.631155 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88119d64-62e2-4cd6-8591-eec1cf6fa944 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:34.631631 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-88119d64-62e2-4cd6-8591-eec1cf6fa944 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:34.632984 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88119d64-62e2-4cd6-8591-eec1cf6fa944 None admin] RBAC: Adding query filter params (domain_id=default, name=glance-swift) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:34.633550 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88119d64-62e2-4cd6-8591-eec1cf6fa944 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:34.636216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-88119d64-62e2-4cd6-8591-eec1cf6fa944 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:34.639755 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:34.668920 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 491/976] 10.222.0.49 () {56 vars in 1149 bytes} [Sun Aug 21 00:53:34 2022] GET /identity/v3/users?domain_id=default&name=glance-swift => generated 384 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:34.680357 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b912d7-9edf-447b-9dfd-27423f9d6db1 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:34.720652 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:34.779629 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549c4a2-907f-4d90-a8cc-c2c59899f58b None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:34.780162 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549c4a2-907f-4d90-a8cc-c2c59899f58b None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:34.780753 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3549c4a2-907f-4d90-a8cc-c2c59899f58b None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:34.783943 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 492/977] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:34 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:53:34.794125 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb91249-b29d-4110-9965-e4d6567d484f None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:34.795499 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb91249-b29d-4110-9965-e4d6567d484f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:34.796103 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7eb91249-b29d-4110-9965-e4d6567d484f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:34.821408 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-7eb91249-b29d-4110-9965-e4d6567d484f None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:34.822699 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7eb91249-b29d-4110-9965-e4d6567d484f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:34.867204 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e9b912d7-9edf-447b-9dfd-27423f9d6db1 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:34.913973 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb7418-64cd-4287-a4d6-3730a7685a3a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:34.914825 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb7418-64cd-4287-a4d6-3730a7685a3a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:34.915168 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb7418-64cd-4287-a4d6-3730a7685a3a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:34.915504 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4adb7418-64cd-4287-a4d6-3730a7685a3a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:34.932204 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 493/978] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:34 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 140 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:35.045216 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb7418-64cd-4287-a4d6-3730a7685a3a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:35.048001 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4adb7418-64cd-4287-a4d6-3730a7685a3a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:35.090268 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:35.257709 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 486/979] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:53:34 2022] GET /identity/v3/auth/tokens => generated 1570 bytes in 580 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:53:35.260679 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb91249-b29d-4110-9965-e4d6567d484f None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:35.261793 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb7418-64cd-4287-a4d6-3730a7685a3a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:35.443021 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7eb91249-b29d-4110-9965-e4d6567d484f None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:35.452739 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4adb7418-64cd-4287-a4d6-3730a7685a3a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:35.484349 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:35.495116 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:35.505367 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7057e26-1b0c-4ddb-9fbf-edf823a2f0b2 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:35.506339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7057e26-1b0c-4ddb-9fbf-edf823a2f0b2 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:35.506625 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7057e26-1b0c-4ddb-9fbf-edf823a2f0b2 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:35.506989 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7057e26-1b0c-4ddb-9fbf-edf823a2f0b2 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:35.519886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7057e26-1b0c-4ddb-9fbf-edf823a2f0b2 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:35.521472 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7057e26-1b0c-4ddb-9fbf-edf823a2f0b2 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:35.524611 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b23746-85ee-4767-a6e0-6a23e82cff3d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:35.525659 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b23746-85ee-4767-a6e0-6a23e82cff3d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:35.526130 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b23746-85ee-4767-a6e0-6a23e82cff3d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:35.526668 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77b23746-85ee-4767-a6e0-6a23e82cff3d None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:35.527758 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b23746-85ee-4767-a6e0-6a23e82cff3d None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:35.530493 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77b23746-85ee-4767-a6e0-6a23e82cff3d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:35.539548 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-d7057e26-1b0c-4ddb-9fbf-edf823a2f0b2 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:35.539548 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:35.539548 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:35.539548 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:35.539548 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:35.539548 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:35.539548 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:35.539548 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:35.539548 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:35.539548 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:35.539548 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:35.539548 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:35.539548 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:35.539548 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:35.539548 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:35.539548 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:35.549328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:35.549328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:35.549328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:35.549328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:35.549328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:35.549328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:35.549328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:35.549328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:35.549328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:35.549328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:35.549328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:35.549328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:35.549328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:35.549328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:35.549328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:35.549328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:35.549328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:35.551005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:35.551005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:35.551005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:35.551005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 494/980] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 281 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:35.551376 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-77b23746-85ee-4767-a6e0-6a23e82cff3d None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:53:35.551376 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:35.551376 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:53:35.551376 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:53:35.551376 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:53:35.551376 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:53:35.551376 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:53:35.551376 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:35.551376 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:53:35.551376 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:35.551376 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:53:35.551376 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:35.551376 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:35.551376 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:35.551376 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:35.551376 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:35.551376 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:35.552874 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:35.552874 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:35.552874 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:35.552874 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:35.552874 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:35.552874 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:35.552874 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:53:35.552874 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:53:35.552874 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:53:35.552874 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:53:35.552874 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:35.552874 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:35.552874 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:35.552874 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:35.552874 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:35.552874 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:35.556417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:35.556417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:35.556417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:35.556417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:35.556417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:35.556417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:35.556417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:35.556417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:35.556417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:35.556417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:35.556417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:53:35.556417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:35.556417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:53:35.556417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:35.556417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 487/981] 10.222.0.49 () {56 vars in 1126 bytes} [Sun Aug 21 00:53:35 2022] GET /identity/v3/services/object-store => generated 93 bytes in 286 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:53:35.561302 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7057e26-1b0c-4ddb-9fbf-edf823a2f0b2 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:35.561575 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b23746-85ee-4767-a6e0-6a23e82cff3d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:35.706079 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7057e26-1b0c-4ddb-9fbf-edf823a2f0b2 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:35.753757 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c56c5-510e-4efc-9349-2d9be10a5a0c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:35.754628 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c56c5-510e-4efc-9349-2d9be10a5a0c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:35.755118 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c56c5-510e-4efc-9349-2d9be10a5a0c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:35.755333 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77b23746-85ee-4767-a6e0-6a23e82cff3d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:35.755597 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b0c56c5-510e-4efc-9349-2d9be10a5a0c None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:35.756804 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c56c5-510e-4efc-9349-2d9be10a5a0c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:35.757386 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c56c5-510e-4efc-9349-2d9be10a5a0c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:35.760087 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2b0c56c5-510e-4efc-9349-2d9be10a5a0c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:35.786700 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 495/982] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:35.790796 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c56c5-510e-4efc-9349-2d9be10a5a0c None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:35.815044 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfebd8-a920-4825-8045-8d3c9b7c60c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:35.815870 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfebd8-a920-4825-8045-8d3c9b7c60c4 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:35.816308 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfebd8-a920-4825-8045-8d3c9b7c60c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:35.816751 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-94cfebd8-a920-4825-8045-8d3c9b7c60c4 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:35.817715 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfebd8-a920-4825-8045-8d3c9b7c60c4 None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:35.818011 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfebd8-a920-4825-8045-8d3c9b7c60c4 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:35.819926 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-94cfebd8-a920-4825-8045-8d3c9b7c60c4 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:35.833777 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 488/983] 10.222.0.49 () {56 vars in 1122 bytes} [Sun Aug 21 00:53:35 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:35.838220 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfebd8-a920-4825-8045-8d3c9b7c60c4 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:35.850923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:35.935274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:35.972328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b0c56c5-510e-4efc-9349-2d9be10a5a0c None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:36.032421 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-94cfebd8-a920-4825-8045-8d3c9b7c60c4 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:36.043274 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365a8f0-7ca2-4e27-9499-8339209fa135 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:36.043937 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365a8f0-7ca2-4e27-9499-8339209fa135 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:36.044221 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365a8f0-7ca2-4e27-9499-8339209fa135 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:36.044504 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7365a8f0-7ca2-4e27-9499-8339209fa135 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:36.054152 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365a8f0-7ca2-4e27-9499-8339209fa135 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:36.055946 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7365a8f0-7ca2-4e27-9499-8339209fa135 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:36.072050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-7365a8f0-7ca2-4e27-9499-8339209fa135 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:36.072050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:36.072050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:36.072050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:36.072050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:36.072050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:36.072050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:36.072050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:36.072050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:36.072050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:36.072050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:36.072050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:36.072050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:53:36.072050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:53:36.072050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:53:36.074105 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:53:36.074105 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:36.074105 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:36.074105 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:36.074105 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:36.074105 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:36.074105 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:36.074105 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:36.074105 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:36.074105 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:36.074105 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:36.074105 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:36.074105 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:36.074105 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:36.074105 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:36.074105 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:36.074105 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:36.075823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:53:36.075823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:53:36.075823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:53:36.075823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:53:36.075823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:53:36.075823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:53:36.075823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:36.075823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:36.075823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 496/984] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:53:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 285 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:53:36.080985 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365a8f0-7ca2-4e27-9499-8339209fa135 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:36.093751 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73709763-682a-4824-89c3-1fa8d9a95107 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:36.094613 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73709763-682a-4824-89c3-1fa8d9a95107 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:36.095031 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73709763-682a-4824-89c3-1fa8d9a95107 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:36.095404 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-73709763-682a-4824-89c3-1fa8d9a95107 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:36.096403 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73709763-682a-4824-89c3-1fa8d9a95107 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:36.096943 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73709763-682a-4824-89c3-1fa8d9a95107 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:36.099167 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-73709763-682a-4824-89c3-1fa8d9a95107 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:36.106682 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 489/985] 10.222.0.49 () {56 vars in 1122 bytes} [Sun Aug 21 00:53:35 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:36.114264 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73709763-682a-4824-89c3-1fa8d9a95107 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:36.206810 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:36.223275 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7365a8f0-7ca2-4e27-9499-8339209fa135 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:36.282702 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-73709763-682a-4824-89c3-1fa8d9a95107 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:36.288656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2d62c-328b-48ce-8e47-f60e71131f10 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:36.289565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2d62c-328b-48ce-8e47-f60e71131f10 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:36.289820 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2d62c-328b-48ce-8e47-f60e71131f10 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:36.290251 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ed2d62c-328b-48ce-8e47-f60e71131f10 None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:36.291113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2d62c-328b-48ce-8e47-f60e71131f10 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:36.291540 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2d62c-328b-48ce-8e47-f60e71131f10 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:36.293445 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ed2d62c-328b-48ce-8e47-f60e71131f10 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:36.310058 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:36.315961 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 497/986] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:53:36 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 235 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:36.323876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2d62c-328b-48ce-8e47-f60e71131f10 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:36.356928 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-161a26bb-726b-4e3c-9299-6758270a48b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:36.357827 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a26bb-726b-4e3c-9299-6758270a48b9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:36.358274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a26bb-726b-4e3c-9299-6758270a48b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:36.358593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-161a26bb-726b-4e3c-9299-6758270a48b9 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:36.359502 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a26bb-726b-4e3c-9299-6758270a48b9 None admin] RBAC: Adding query filter params (interface=admin, service_id=714a3f5afb6d4164a89dd71bedcc0951, region_id=RegionOne) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:36.360019 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a26bb-726b-4e3c-9299-6758270a48b9 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:36.361969 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-161a26bb-726b-4e3c-9299-6758270a48b9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:36.377145 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 490/987] 10.222.0.49 () {56 vars in 1249 bytes} [Sun Aug 21 00:53:36 2022] GET /identity/v3/endpoints?service_id=714a3f5afb6d4164a89dd71bedcc0951&interface=admin®ion_id=RegionOne => generated 193 bytes in 258 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:36.378620 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3346d-f48f-4de4-aa94-c587b753bf11 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:36.379071 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3346d-f48f-4de4-aa94-c587b753bf11 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:36.379509 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d3346d-f48f-4de4-aa94-c587b753bf11 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:36.381137 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 491/988] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:36 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:36.381928 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3346d-f48f-4de4-aa94-c587b753bf11 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:36.505651 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ed2d62c-328b-48ce-8e47-f60e71131f10 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:36.515923 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d3346d-f48f-4de4-aa94-c587b753bf11 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:36.554891 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6c2be617-c8dd-405b-b070-fb0f40887d0d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:36.555512 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2be617-c8dd-405b-b070-fb0f40887d0d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:36.555776 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2be617-c8dd-405b-b070-fb0f40887d0d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:36.556047 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6c2be617-c8dd-405b-b070-fb0f40887d0d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:36.556781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2be617-c8dd-405b-b070-fb0f40887d0d None admin] RBAC: Adding query filter params (role.id=bfc1c16a629c46a0883a2f7363d940cf, scope.project.id=838e996d09a0454b9bcdc5aef03ef203, user.id=a06f043017114f9090264293f5ede6c4) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:36.557120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2be617-c8dd-405b-b070-fb0f40887d0d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:36.558638 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6c2be617-c8dd-405b-b070-fb0f40887d0d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:36.561381 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad94f6f-60be-4c20-86d0-2e6ae1b9ebad None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:36.562015 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad94f6f-60be-4c20-86d0-2e6ae1b9ebad None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:36.562298 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad94f6f-60be-4c20-86d0-2e6ae1b9ebad None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:36.562569 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dad94f6f-60be-4c20-86d0-2e6ae1b9ebad None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:36.563246 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad94f6f-60be-4c20-86d0-2e6ae1b9ebad None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:36.564686 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dad94f6f-60be-4c20-86d0-2e6ae1b9ebad None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:36.581119 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 498/989] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:53:36 2022] GET /identity/v3/role_assignments?user.id=a06f043017114f9090264293f5ede6c4&scope.project.id=838e996d09a0454b9bcdc5aef03ef203&role.id=bfc1c16a629c46a0883a2f7363d940cf => generated 608 bytes in 245 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:36.581119 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b176e24-9fb8-4259-b66d-cc2db0848f25 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:36.581119 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b176e24-9fb8-4259-b66d-cc2db0848f25 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:36.581119 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b176e24-9fb8-4259-b66d-cc2db0848f25 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:36.581621 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 492/990] 10.222.0.49 () {56 vars in 1087 bytes} [Sun Aug 21 00:53:36 2022] GET /identity/v3/services => generated 1727 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 00:53:36.601825 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-1b176e24-9fb8-4259-b66d-cc2db0848f25 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:36.603825 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-1b176e24-9fb8-4259-b66d-cc2db0848f25 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:36.629138 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:36.712908 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 499/991] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:36 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 144 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:37.007127 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad94f6f-60be-4c20-86d0-2e6ae1b9ebad None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:37.088353 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:37.200717 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dad94f6f-60be-4c20-86d0-2e6ae1b9ebad None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:37.271632 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fa104-24db-4fa8-b7ba-aff1de8fb186 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:37.272744 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fa104-24db-4fa8-b7ba-aff1de8fb186 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:37.273352 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fa104-24db-4fa8-b7ba-aff1de8fb186 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:37.273945 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a05fa104-24db-4fa8-b7ba-aff1de8fb186 None admin] PATH_INFO: `/v3/services/compute` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:37.275073 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fa104-24db-4fa8-b7ba-aff1de8fb186 None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:37.277748 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a05fa104-24db-4fa8-b7ba-aff1de8fb186 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:37.294955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-a05fa104-24db-4fa8-b7ba-aff1de8fb186 None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 00:53:37.294955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:37.294955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:53:37.294955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:53:37.294955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:53:37.294955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:53:37.294955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:53:37.294955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:37.294955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 00:53:37.294955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:37.294955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:53:37.294955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:37.294955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:37.294955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:37.294955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:37.294955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:37.294955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:37.298117 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:37.298117 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:37.298117 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:37.298117 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:37.298117 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:37.298117 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:37.298117 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:53:37.298117 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:53:37.298117 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:53:37.298117 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:53:37.298117 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:37.298117 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:37.298117 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:37.298117 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:37.298117 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:37.298117 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:37.299761 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:37.299761 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:37.299761 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:37.299761 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:37.299761 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:37.299761 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:37.299761 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:37.299761 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:37.299761 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:37.299761 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:37.299761 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:53:37.299761 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:37.299761 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 00:53:37.299761 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:37.299761 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 493/992] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:53:37 2022] GET /identity/v3/services/compute => generated 88 bytes in 291 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:37.306617 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b176e24-9fb8-4259-b66d-cc2db0848f25 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:37.509730 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b176e24-9fb8-4259-b66d-cc2db0848f25 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:37.583005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44693fa-65e7-4a66-9af4-932cef8a2b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:37.584939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44693fa-65e7-4a66-9af4-932cef8a2b79 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:37.585809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44693fa-65e7-4a66-9af4-932cef8a2b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:37.586510 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d44693fa-65e7-4a66-9af4-932cef8a2b79 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:37.588151 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44693fa-65e7-4a66-9af4-932cef8a2b79 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:37.589178 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44693fa-65e7-4a66-9af4-932cef8a2b79 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:37.592551 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d44693fa-65e7-4a66-9af4-932cef8a2b79 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:37.605298 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 500/993] 10.222.0.49 () {56 vars in 1112 bytes} [Sun Aug 21 00:53:37 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 300 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:37.615456 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fa104-24db-4fa8-b7ba-aff1de8fb186 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:37.796969 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a05fa104-24db-4fa8-b7ba-aff1de8fb186 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:37.801819 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:37.869474 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edbb98-9d08-4c12-93e5-99db1f5806a0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:37.870724 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edbb98-9d08-4c12-93e5-99db1f5806a0 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:37.871332 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edbb98-9d08-4c12-93e5-99db1f5806a0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:37.871939 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34edbb98-9d08-4c12-93e5-99db1f5806a0 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:37.873351 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edbb98-9d08-4c12-93e5-99db1f5806a0 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:37.874028 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edbb98-9d08-4c12-93e5-99db1f5806a0 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:37.877273 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-34edbb98-9d08-4c12-93e5-99db1f5806a0 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:37.893158 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 494/994] 10.222.0.49 () {56 vars in 1112 bytes} [Sun Aug 21 00:53:37 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:37.897462 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44693fa-65e7-4a66-9af4-932cef8a2b79 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:37.923381 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:38.084349 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d44693fa-65e7-4a66-9af4-932cef8a2b79 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:38.147675 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23b6a802-42e1-4e99-8c61-94480c383f37 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:38.148436 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6a802-42e1-4e99-8c61-94480c383f37 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:38.148932 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6a802-42e1-4e99-8c61-94480c383f37 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:38.149452 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23b6a802-42e1-4e99-8c61-94480c383f37 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:38.150782 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6a802-42e1-4e99-8c61-94480c383f37 None admin] RBAC: Adding query filter params (interface=public, service_id=4e25e482834649e089296d698a3af5b7, region_id=RegionOne) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:38.151422 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6a802-42e1-4e99-8c61-94480c383f37 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:38.154048 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23b6a802-42e1-4e99-8c61-94480c383f37 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:38.169345 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 501/995] 10.222.0.49 () {56 vars in 1251 bytes} [Sun Aug 21 00:53:37 2022] GET /identity/v3/endpoints?service_id=4e25e482834649e089296d698a3af5b7&interface=public®ion_id=RegionOne => generated 194 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:38.173857 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edbb98-9d08-4c12-93e5-99db1f5806a0 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:38.372017 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34edbb98-9d08-4c12-93e5-99db1f5806a0 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:38.435815 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52857f76-0ff3-4ca0-8a64-657b6bda68b9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:38.436754 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52857f76-0ff3-4ca0-8a64-657b6bda68b9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:38.437218 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52857f76-0ff3-4ca0-8a64-657b6bda68b9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:38.437704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52857f76-0ff3-4ca0-8a64-657b6bda68b9 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:38.438817 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52857f76-0ff3-4ca0-8a64-657b6bda68b9 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:38.441443 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52857f76-0ff3-4ca0-8a64-657b6bda68b9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:38.461092 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 495/996] 10.222.0.49 () {56 vars in 1087 bytes} [Sun Aug 21 00:53:38 2022] GET /identity/v3/services => generated 1727 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 00:53:38.964035 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c561e-e0e3-4809-be4a-bddd5d7e7fda None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:38.964808 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c561e-e0e3-4809-be4a-bddd5d7e7fda None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:38.964808 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce5c561e-e0e3-4809-be4a-bddd5d7e7fda None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:38.965983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 502/997] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:53:38.973007 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02372f-92cb-432b-9a0b-aebbc0fe656e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:38.973607 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02372f-92cb-432b-9a0b-aebbc0fe656e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:38.974108 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b02372f-92cb-432b-9a0b-aebbc0fe656e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:39.003602 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-5b02372f-92cb-432b-9a0b-aebbc0fe656e None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:39.006099 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5b02372f-92cb-432b-9a0b-aebbc0fe656e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:39.052054 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:39.058180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64766f-ec96-41a8-8b65-ceb41799c64f None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:39.059423 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64766f-ec96-41a8-8b65-ceb41799c64f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:39.059816 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae64766f-ec96-41a8-8b65-ceb41799c64f None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:39.062469 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 503/998] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:39.072429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf608fc-8c77-4687-bca4-2f62ec5e56c6 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:39.073336 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf608fc-8c77-4687-bca4-2f62ec5e56c6 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:39.074048 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fdf608fc-8c77-4687-bca4-2f62ec5e56c6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:39.105736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-fdf608fc-8c77-4687-bca4-2f62ec5e56c6 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:39.108072 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-fdf608fc-8c77-4687-bca4-2f62ec5e56c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:39.130180 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 496/999] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:38 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 159 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:53:39.202501 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 504/1000] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:39 2022] POST /identity/v3/auth/tokens => generated 1570 bytes in 132 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:39.509555 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02372f-92cb-432b-9a0b-aebbc0fe656e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:39.619378 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf608fc-8c77-4687-bca4-2f62ec5e56c6 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:39.635900 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:39.706193 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b02372f-92cb-432b-9a0b-aebbc0fe656e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:39.772138 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3b38b-5520-4c76-b082-e8ec901f9735 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:39.772691 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3b38b-5520-4c76-b082-e8ec901f9735 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:39.772999 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3b38b-5520-4c76-b082-e8ec901f9735 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:39.773295 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51e3b38b-5520-4c76-b082-e8ec901f9735 None admin] PATH_INFO: `/v3/services/object-store` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:39.774030 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3b38b-5520-4c76-b082-e8ec901f9735 None admin] RBAC: Authorizing `identity:get_service(service_id=object-store)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:39.775585 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51e3b38b-5520-4c76-b082-e8ec901f9735 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:39.785798 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-51e3b38b-5520-4c76-b082-e8ec901f9735 None admin] Could not find service: object-store.: keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:53:39.785798 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:39.785798 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:53:39.785798 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:53:39.785798 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:53:39.785798 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:53:39.785798 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:53:39.785798 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:39.785798 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:53:39.785798 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:39.785798 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:53:39.785798 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:39.785798 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:39.785798 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:39.785798 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:39.785798 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:39.785798 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:39.789634 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:39.789634 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:39.789634 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:39.789634 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:39.789634 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:39.789634 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:39.789634 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:53:39.789634 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:53:39.789634 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:53:39.789634 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:53:39.789634 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:39.789634 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:39.789634 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:39.789634 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:39.789634 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:39.789634 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:39.790534 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:39.790534 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:39.790534 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:39.790534 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:39.790534 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:39.790534 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:39.790534 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:39.790534 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:39.790534 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:39.790534 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:39.790534 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:53:39.790534 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:39.790534 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: object-store. Aug 21 00:53:39.790534 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:39.790534 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 497/1001] 10.222.0.49 () {56 vars in 1126 bytes} [Sun Aug 21 00:53:39 2022] GET /identity/v3/services/object-store => generated 93 bytes in 279 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:53:39.799937 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3b38b-5520-4c76-b082-e8ec901f9735 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:39.804120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fdf608fc-8c77-4687-bca4-2f62ec5e56c6 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:39.853275 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:39.863058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ffa39-1c67-4c99-9833-9bb4e6e9f936 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:39.864149 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ffa39-1c67-4c99-9833-9bb4e6e9f936 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:39.864449 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ffa39-1c67-4c99-9833-9bb4e6e9f936 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:39.864893 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e99ffa39-1c67-4c99-9833-9bb4e6e9f936 None admin] PATH_INFO: `/v3/services/image` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:39.866329 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ffa39-1c67-4c99-9833-9bb4e6e9f936 None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:39.870472 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e99ffa39-1c67-4c99-9833-9bb4e6e9f936 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:39.885902 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-e99ffa39-1c67-4c99-9833-9bb4e6e9f936 None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 00:53:39.885902 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:39.885902 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:53:39.885902 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:53:39.885902 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:53:39.885902 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:53:39.885902 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:53:39.885902 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:39.885902 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 00:53:39.885902 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:39.885902 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:53:39.885902 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:39.885902 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:39.885902 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:39.885902 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:39.885902 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:39.885902 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:39.887050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:39.887050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:39.887050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:39.887050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:39.887050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:39.887050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:39.887050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:53:39.887050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:53:39.887050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:53:39.887050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:53:39.887050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:39.887050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:39.887050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:39.887050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:39.887050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:39.887050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:39.888588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:39.888588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:39.888588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:39.888588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:39.888588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:39.888588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:39.888588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:39.888588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:39.888588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:39.888588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:39.888588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:53:39.888588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:39.888588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 00:53:39.888588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:39.888588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 505/1002] 10.222.0.49 () {56 vars in 1105 bytes} [Sun Aug 21 00:53:39 2022] GET /identity/v3/services/image => generated 86 bytes in 269 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:39.896983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ffa39-1c67-4c99-9833-9bb4e6e9f936 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:39.990892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51e3b38b-5520-4c76-b082-e8ec901f9735 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:40.018147 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:40.044212 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ba7e1-6998-45e9-9ae2-ca3676512b0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:40.045182 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ba7e1-6998-45e9-9ae2-ca3676512b0f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:40.045633 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ba7e1-6998-45e9-9ae2-ca3676512b0f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:40.046832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dc2ba7e1-6998-45e9-9ae2-ca3676512b0f None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:40.048003 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ba7e1-6998-45e9-9ae2-ca3676512b0f None admin] RBAC: Adding query filter params (name=object-store) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:40.048529 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ba7e1-6998-45e9-9ae2-ca3676512b0f None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:40.051160 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dc2ba7e1-6998-45e9-9ae2-ca3676512b0f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:40.065980 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 498/1003] 10.222.0.49 () {56 vars in 1122 bytes} [Sun Aug 21 00:53:39 2022] GET /identity/v3/services?name=object-store => generated 129 bytes in 261 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:40.066261 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e99ffa39-1c67-4c99-9833-9bb4e6e9f936 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:40.070275 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ba7e1-6998-45e9-9ae2-ca3676512b0f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:40.124360 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dafc00-d379-4b84-bbcc-c0fe862a8690 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:40.125529 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dafc00-d379-4b84-bbcc-c0fe862a8690 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:40.125996 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dafc00-d379-4b84-bbcc-c0fe862a8690 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:40.126450 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d1dafc00-d379-4b84-bbcc-c0fe862a8690 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:40.127252 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dafc00-d379-4b84-bbcc-c0fe862a8690 None admin] RBAC: Adding query filter params (name=image) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:40.127681 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dafc00-d379-4b84-bbcc-c0fe862a8690 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:40.129277 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d1dafc00-d379-4b84-bbcc-c0fe862a8690 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:40.141005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 506/1004] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:39 2022] GET /identity/v3/services?name=image => generated 122 bytes in 240 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:40.142601 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dafc00-d379-4b84-bbcc-c0fe862a8690 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:40.219535 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:40.235059 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dc2ba7e1-6998-45e9-9ae2-ca3676512b0f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:40.272702 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61c5b7-aad2-4624-8352-96578063efa5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:40.273468 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61c5b7-aad2-4624-8352-96578063efa5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:40.273809 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61c5b7-aad2-4624-8352-96578063efa5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:40.274133 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b61c5b7-aad2-4624-8352-96578063efa5 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:40.274912 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61c5b7-aad2-4624-8352-96578063efa5 None admin] RBAC: Adding query filter params (type=object-store) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:40.275419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61c5b7-aad2-4624-8352-96578063efa5 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:40.277259 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b61c5b7-aad2-4624-8352-96578063efa5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:40.284100 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 499/1005] 10.222.0.49 () {56 vars in 1122 bytes} [Sun Aug 21 00:53:40 2022] GET /identity/v3/services?type=object-store => generated 356 bytes in 216 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:40.291066 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61c5b7-aad2-4624-8352-96578063efa5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:40.307349 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d1dafc00-d379-4b84-bbcc-c0fe862a8690 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:40.371998 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c4da942-6dee-4ba1-829d-12c736a9474d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:40.372976 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4da942-6dee-4ba1-829d-12c736a9474d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:40.373446 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4da942-6dee-4ba1-829d-12c736a9474d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:40.373874 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c4da942-6dee-4ba1-829d-12c736a9474d None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:40.375069 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4da942-6dee-4ba1-829d-12c736a9474d None admin] RBAC: Adding query filter params (type=image) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:40.375693 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4da942-6dee-4ba1-829d-12c736a9474d None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:40.377994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c4da942-6dee-4ba1-829d-12c736a9474d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:40.379940 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:40.388634 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 507/1006] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:40 2022] GET /identity/v3/services?type=image => generated 122 bytes in 247 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:40.470296 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b61c5b7-aad2-4624-8352-96578063efa5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:40.547766 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6230f5d4-eb34-4a68-ab14-4d15f8691007 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:40.549180 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230f5d4-eb34-4a68-ab14-4d15f8691007 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:40.549807 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230f5d4-eb34-4a68-ab14-4d15f8691007 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:40.550368 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6230f5d4-eb34-4a68-ab14-4d15f8691007 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:40.551891 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230f5d4-eb34-4a68-ab14-4d15f8691007 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:40.555120 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6230f5d4-eb34-4a68-ab14-4d15f8691007 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:40.589818 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 500/1007] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 21 00:53:40 2022] POST /identity/v3/endpoints => generated 325 bytes in 300 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:53:40.748485 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b5a46-08f1-4514-a1c8-6d26cd095db3 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:40.748912 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b5a46-08f1-4514-a1c8-6d26cd095db3 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:40.749345 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c5b5a46-08f1-4514-a1c8-6d26cd095db3 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:40.751070 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 508/1008] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:53:40.756729 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add6502-6ef0-433f-a7bb-95b4f1ed2f1b None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:40.757015 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add6502-6ef0-433f-a7bb-95b4f1ed2f1b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:40.757313 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5add6502-6ef0-433f-a7bb-95b4f1ed2f1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:40.777076 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-5add6502-6ef0-433f-a7bb-95b4f1ed2f1b None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:40.778282 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5add6502-6ef0-433f-a7bb-95b4f1ed2f1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:40.790027 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:40.881128 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 501/1009] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:40 2022] POST /identity/v3/auth/tokens => generated 1717 bytes in 125 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:41.358599 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b5a46-08f1-4514-a1c8-6d26cd095db3 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:41.555748 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c5b5a46-08f1-4514-a1c8-6d26cd095db3 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:41.621882 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3030c-bb4e-422b-a223-24599184f9ee None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:41.622942 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3030c-bb4e-422b-a223-24599184f9ee None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:41.623421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3030c-bb4e-422b-a223-24599184f9ee None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:41.623888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b3030c-bb4e-422b-a223-24599184f9ee None admin] PATH_INFO: `/v3/services/compute` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:41.624928 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3030c-bb4e-422b-a223-24599184f9ee None admin] RBAC: Authorizing `identity:get_service(service_id=compute)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:41.627829 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b3030c-bb4e-422b-a223-24599184f9ee None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:41.645234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-11b3030c-bb4e-422b-a223-24599184f9ee None admin] Could not find service: compute.: keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 00:53:41.645234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:41.645234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:53:41.645234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:53:41.645234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:53:41.645234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:53:41.645234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:53:41.645234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:41.645234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 00:53:41.645234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:41.645234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:53:41.645234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:41.645234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:41.645234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:41.645234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:41.645234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:41.645234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:41.647216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:41.647216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:41.647216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:41.647216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:41.647216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:41.647216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:41.647216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:53:41.647216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:53:41.647216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:53:41.647216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:53:41.647216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:41.647216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:41.647216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:41.647216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:41.647216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:41.647216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:41.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:41.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:41.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:41.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:41.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:41.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:41.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:41.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:41.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:41.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:41.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:53:41.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:41.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: compute. Aug 21 00:53:41.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:41.648888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 509/1010] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:53:41 2022] GET /identity/v3/services/compute => generated 88 bytes in 290 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:41.658591 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add6502-6ef0-433f-a7bb-95b4f1ed2f1b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:41.827136 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5add6502-6ef0-433f-a7bb-95b4f1ed2f1b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:41.893349 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cc4a4-b9ec-45e2-8098-49fc77ffc773 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:41.894391 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cc4a4-b9ec-45e2-8098-49fc77ffc773 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:41.894869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cc4a4-b9ec-45e2-8098-49fc77ffc773 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:41.895370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-971cc4a4-b9ec-45e2-8098-49fc77ffc773 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:41.896517 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971cc4a4-b9ec-45e2-8098-49fc77ffc773 None admin] RBAC: Adding query filter params (name=compute) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:41.897035 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971cc4a4-b9ec-45e2-8098-49fc77ffc773 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:41.899614 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-971cc4a4-b9ec-45e2-8098-49fc77ffc773 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:41.916985 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 502/1011] 10.222.0.49 () {56 vars in 1112 bytes} [Sun Aug 21 00:53:41 2022] GET /identity/v3/services?name=compute => generated 124 bytes in 254 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:41.919419 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3030c-bb4e-422b-a223-24599184f9ee None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:42.021263 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:42.075251 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b3030c-bb4e-422b-a223-24599184f9ee None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:42.123424 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5943499f-079c-4f9b-a449-e94c91f85f60 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:42.123931 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943499f-079c-4f9b-a449-e94c91f85f60 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:42.124197 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943499f-079c-4f9b-a449-e94c91f85f60 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:42.124461 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5943499f-079c-4f9b-a449-e94c91f85f60 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:42.125174 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943499f-079c-4f9b-a449-e94c91f85f60 None admin] RBAC: Adding query filter params (type=compute) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:42.125810 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943499f-079c-4f9b-a449-e94c91f85f60 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:42.127204 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5943499f-079c-4f9b-a449-e94c91f85f60 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:42.133398 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 510/1012] 10.222.0.49 () {56 vars in 1112 bytes} [Sun Aug 21 00:53:41 2022] GET /identity/v3/services?type=compute => generated 352 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:42.140025 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cc4a4-b9ec-45e2-8098-49fc77ffc773 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:42.146425 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:42.329581 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-971cc4a4-b9ec-45e2-8098-49fc77ffc773 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:42.390805 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02101ec9-eb9a-4b17-8575-ecc6c63ab228 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:42.391742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02101ec9-eb9a-4b17-8575-ecc6c63ab228 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:42.392228 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02101ec9-eb9a-4b17-8575-ecc6c63ab228 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:42.392669 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02101ec9-eb9a-4b17-8575-ecc6c63ab228 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:42.393873 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02101ec9-eb9a-4b17-8575-ecc6c63ab228 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:42.396507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02101ec9-eb9a-4b17-8575-ecc6c63ab228 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:42.427474 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 503/1013] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 21 00:53:42 2022] POST /identity/v3/endpoints => generated 334 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:53:42.755712 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cae68a-80f7-423e-b54b-77504532ac0e None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:42.757273 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cae68a-80f7-423e-b54b-77504532ac0e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:42.757273 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79cae68a-80f7-423e-b54b-77504532ac0e None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:42.759372 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 511/1014] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:42.768319 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9eef7f-d457-4a9c-be19-108d72720797 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:42.769107 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9eef7f-d457-4a9c-be19-108d72720797 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:42.769408 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a9eef7f-d457-4a9c-be19-108d72720797 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:42.799626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-6a9eef7f-d457-4a9c-be19-108d72720797 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:42.801612 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6a9eef7f-d457-4a9c-be19-108d72720797 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:42.901357 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:42.935778 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 504/1015] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:42 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:53:43.028251 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3acd3f-1103-4114-b6ff-28f26d9bbf63 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:43.028478 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3acd3f-1103-4114-b6ff-28f26d9bbf63 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:43.028753 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ba3acd3f-1103-4114-b6ff-28f26d9bbf63 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:43.030253 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 512/1016] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:53:43.035771 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533eedc-aba5-4713-8e83-0e2e1a39ff5b None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:43.036059 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533eedc-aba5-4713-8e83-0e2e1a39ff5b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:43.036334 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6533eedc-aba5-4713-8e83-0e2e1a39ff5b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:43.055351 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-6533eedc-aba5-4713-8e83-0e2e1a39ff5b None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:43.056550 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6533eedc-aba5-4713-8e83-0e2e1a39ff5b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:43.131684 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 505/1017] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:43 2022] POST /identity/v3/auth/tokens => generated 1873 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:43.335530 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3acd3f-1103-4114-b6ff-28f26d9bbf63 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:43.394606 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533eedc-aba5-4713-8e83-0e2e1a39ff5b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:43.505492 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ba3acd3f-1103-4114-b6ff-28f26d9bbf63 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:43.540672 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6533eedc-aba5-4713-8e83-0e2e1a39ff5b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:43.550921 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:43.564659 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccfb7e-388e-4815-b586-cb9476cb21b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:43.565138 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccfb7e-388e-4815-b586-cb9476cb21b5 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:43.565359 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccfb7e-388e-4815-b586-cb9476cb21b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:43.565607 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60ccfb7e-388e-4815-b586-cb9476cb21b5 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:43.566797 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccfb7e-388e-4815-b586-cb9476cb21b5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:43.568278 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60ccfb7e-388e-4815-b586-cb9476cb21b5 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:43.575565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 513/1018] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:43 2022] GET /identity/v3/domains/default => generated 199 bytes in 241 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:43.576586 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccfb7e-388e-4815-b586-cb9476cb21b5 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:43.578228 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:43.620674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dd9fc86-a855-4a97-8265-07dd9c58f005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:43.621803 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9fc86-a855-4a97-8265-07dd9c58f005 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:43.622172 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9fc86-a855-4a97-8265-07dd9c58f005 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:43.622726 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dd9fc86-a855-4a97-8265-07dd9c58f005 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:43.623868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9fc86-a855-4a97-8265-07dd9c58f005 None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:43.626719 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3dd9fc86-a855-4a97-8265-07dd9c58f005 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:43.660004 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 506/1019] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 21 00:53:43 2022] POST /identity/v3/services => generated 242 bytes in 266 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:53:43.748379 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60ccfb7e-388e-4815-b586-cb9476cb21b5 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:43.813084 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2241f56f-332b-417f-9ff0-681f9498fdb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:43.814636 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241f56f-332b-417f-9ff0-681f9498fdb9 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:43.815115 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241f56f-332b-417f-9ff0-681f9498fdb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:43.815548 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2241f56f-332b-417f-9ff0-681f9498fdb9 None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:43.816394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241f56f-332b-417f-9ff0-681f9498fdb9 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:43.818770 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2241f56f-332b-417f-9ff0-681f9498fdb9 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:43.868570 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 514/1020] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 21 00:53:43 2022] POST /identity/v3/projects => generated 311 bytes in 285 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:53:44.846507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0c24c-65d6-4f80-99c0-f7959a275d05 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:44.847301 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0c24c-65d6-4f80-99c0-f7959a275d05 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:44.847481 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cb0c24c-65d6-4f80-99c0-f7959a275d05 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:44.849314 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 507/1021] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:44 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:44.854978 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a634a-14df-440f-a2f0-bff513fef3c3 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:44.855745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a634a-14df-440f-a2f0-bff513fef3c3 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:44.855880 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-130a634a-14df-440f-a2f0-bff513fef3c3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:44.875702 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-130a634a-14df-440f-a2f0-bff513fef3c3 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:44.877086 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-130a634a-14df-440f-a2f0-bff513fef3c3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:44.918908 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:44.958810 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 515/1022] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:44 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 105 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:53:45.225913 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0c24c-65d6-4f80-99c0-f7959a275d05 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:45.346769 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cb0c24c-65d6-4f80-99c0-f7959a275d05 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:45.385658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7fe40-85a0-416a-b805-f5be130e7ea3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:45.386360 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7fe40-85a0-416a-b805-f5be130e7ea3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:45.386816 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7fe40-85a0-416a-b805-f5be130e7ea3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:45.387144 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6de7fe40-85a0-416a-b805-f5be130e7ea3 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:45.401101 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6de7fe40-85a0-416a-b805-f5be130e7ea3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:53:45.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-6de7fe40-85a0-416a-b805-f5be130e7ea3 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:53:45.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:45.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:45.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:45.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:45.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:45.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:45.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:45.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:45.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:45.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:45.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:45.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:53:45.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:53:45.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:53:45.406868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:53:45.408704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:53:45.408704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:53:45.408704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:53:45.408704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:53:45.408704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:45.408704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:45.408704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:45.408704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:45.408704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:45.408704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:45.408704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:45.408704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:45.408704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:45.408704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:45.408704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:45.408704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:45.410398 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:45.410398 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:45.410398 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:45.410398 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:45.410398 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:53:45.410398 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:53:45.410398 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:53:45.410398 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:53:45.410398 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:53:45.410398 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:53:45.410398 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:53:45.410398 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:45.410398 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 508/1023] 10.222.0.49 () {56 vars in 1120 bytes} [Sun Aug 21 00:53:45 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:45.427022 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a634a-14df-440f-a2f0-bff513fef3c3 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:45.623953 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-130a634a-14df-440f-a2f0-bff513fef3c3 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:45.690468 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b20b909a-6e14-4e04-88da-89627f7afe9c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:45.691486 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b909a-6e14-4e04-88da-89627f7afe9c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:45.691961 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b909a-6e14-4e04-88da-89627f7afe9c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:45.692437 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b20b909a-6e14-4e04-88da-89627f7afe9c None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:45.693673 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b909a-6e14-4e04-88da-89627f7afe9c None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:45.694203 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b909a-6e14-4e04-88da-89627f7afe9c None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:45.696767 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b20b909a-6e14-4e04-88da-89627f7afe9c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:45.718677 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 516/1024] 10.222.0.49 () {56 vars in 1115 bytes} [Sun Aug 21 00:53:45 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:45.721037 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7fe40-85a0-416a-b805-f5be130e7ea3 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:45.785696 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:45.885455 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46777c7-113c-4408-b0a1-a5ff0970478d None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:45.886095 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46777c7-113c-4408-b0a1-a5ff0970478d None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:45.886567 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e46777c7-113c-4408-b0a1-a5ff0970478d None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:45.889973 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 517/1025] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:45 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:45.895985 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569872ca-e21a-4cd4-9b42-68e64abe9fa5 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:45.896260 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569872ca-e21a-4cd4-9b42-68e64abe9fa5 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:45.896518 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-569872ca-e21a-4cd4-9b42-68e64abe9fa5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:45.916958 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-569872ca-e21a-4cd4-9b42-68e64abe9fa5 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:45.919123 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-569872ca-e21a-4cd4-9b42-68e64abe9fa5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:45.924407 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6de7fe40-85a0-416a-b805-f5be130e7ea3 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:45.969951 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae791fa7-7c4c-46ad-a7d4-f7414c6b9a12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:45.971229 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae791fa7-7c4c-46ad-a7d4-f7414c6b9a12 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:45.971511 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae791fa7-7c4c-46ad-a7d4-f7414c6b9a12 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:45.971924 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae791fa7-7c4c-46ad-a7d4-f7414c6b9a12 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:45.972507 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:45.992879 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae791fa7-7c4c-46ad-a7d4-f7414c6b9a12 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:45.995425 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae791fa7-7c4c-46ad-a7d4-f7414c6b9a12 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:46.023419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ae791fa7-7c4c-46ad-a7d4-f7414c6b9a12 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:46.023419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:46.023419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:46.023419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:46.023419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:46.023419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:46.023419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:46.023419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:46.023419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:46.023419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:46.023419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:46.023419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:46.023419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:46.023419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:46.023419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:46.023419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:46.024472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:46.024472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:46.024472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:46.024472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:46.024472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:46.024472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:46.024472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:46.024472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:46.024472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:46.024472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:46.024472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:46.024472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:46.024472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:46.024472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:46.024472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:46.024472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:46.024472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:46.025439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:46.025439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:46.025439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:46.029466 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 509/1026] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 309 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:46.034054 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae791fa7-7c4c-46ad-a7d4-f7414c6b9a12 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:46.048683 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 518/1027] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:45 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 154 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:53:46.184655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:46.208074 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae791fa7-7c4c-46ad-a7d4-f7414c6b9a12 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:46.270877 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-23f131b8-c7f9-4497-aaf4-9cc0f0d77f2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:46.271868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f131b8-c7f9-4497-aaf4-9cc0f0d77f2a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:46.272341 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f131b8-c7f9-4497-aaf4-9cc0f0d77f2a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:46.272802 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-23f131b8-c7f9-4497-aaf4-9cc0f0d77f2a None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:46.273944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f131b8-c7f9-4497-aaf4-9cc0f0d77f2a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:46.274471 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f131b8-c7f9-4497-aaf4-9cc0f0d77f2a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:46.277123 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-23f131b8-c7f9-4497-aaf4-9cc0f0d77f2a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:46.307238 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 510/1028] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 267 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:46.310121 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569872ca-e21a-4cd4-9b42-68e64abe9fa5 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:46.350443 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b34b35-4531-455a-899f-b7800c9a4069 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:46.350776 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b34b35-4531-455a-899f-b7800c9a4069 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:46.351115 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b34b35-4531-455a-899f-b7800c9a4069 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:46.353565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 511/1029] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:46.361886 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d692a1c-4072-41b3-a4a6-bbe497eaa05b None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:46.362207 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d692a1c-4072-41b3-a4a6-bbe497eaa05b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:46.362546 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d692a1c-4072-41b3-a4a6-bbe497eaa05b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:46.389944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-0d692a1c-4072-41b3-a4a6-bbe497eaa05b None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:46.391774 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0d692a1c-4072-41b3-a4a6-bbe497eaa05b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:46.465496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-569872ca-e21a-4cd4-9b42-68e64abe9fa5 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:46.478503 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 512/1030] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:46 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:53:46.526863 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3effd6-f32f-4298-ab53-345e03d87648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:46.528008 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3effd6-f32f-4298-ab53-345e03d87648 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:46.528500 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3effd6-f32f-4298-ab53-345e03d87648 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:46.528991 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3effd6-f32f-4298-ab53-345e03d87648 None admin] PATH_INFO: `/v3/users/nova` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:46.542884 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3effd6-f32f-4298-ab53-345e03d87648 None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:46.545639 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3effd6-f32f-4298-ab53-345e03d87648 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:46.552842 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d692a1c-4072-41b3-a4a6-bbe497eaa05b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:46.569497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-1b3effd6-f32f-4298-ab53-345e03d87648 None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:53:46.569497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:46.569497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:46.569497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:46.569497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:46.569497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:46.569497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:46.569497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:46.569497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:46.569497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:46.569497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:46.569497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:46.569497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:53:46.569497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:53:46.569497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:53:46.569497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:53:46.570623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:46.570623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:46.570623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:53:46.570623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:46.570623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:53:46.570623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:46.570623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:46.570623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:46.570623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:46.570623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:46.570623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:46.570623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:46.570623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:46.570623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:46.570623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:46.570623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:46.570623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:46.570623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:46.571799 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:46.571799 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:46.571799 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:53:46.571799 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:53:46.571799 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:53:46.571799 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:53:46.571799 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:53:46.571799 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:53:46.571799 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:53:46.571799 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:46.577262 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 519/1031] 10.222.0.49 () {56 vars in 1093 bytes} [Sun Aug 21 00:53:46 2022] GET /identity/v3/users/nova => generated 82 bytes in 268 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:46.580859 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3effd6-f32f-4298-ab53-345e03d87648 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:46.614575 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:46.703052 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:46.713805 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3effd6-f32f-4298-ab53-345e03d87648 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:46.745586 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d692a1c-4072-41b3-a4a6-bbe497eaa05b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:46.767816 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765f51d-4eb6-4e24-a4a5-3589de4074c9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:46.768483 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765f51d-4eb6-4e24-a4a5-3589de4074c9 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:46.768782 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765f51d-4eb6-4e24-a4a5-3589de4074c9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:46.769094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8765f51d-4eb6-4e24-a4a5-3589de4074c9 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:46.769880 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765f51d-4eb6-4e24-a4a5-3589de4074c9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:46.770235 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765f51d-4eb6-4e24-a4a5-3589de4074c9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:46.771821 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8765f51d-4eb6-4e24-a4a5-3589de4074c9 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:46.792765 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a02d7-c5f6-4bfb-9284-d85792175a4b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:46.798708 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a02d7-c5f6-4bfb-9284-d85792175a4b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:46.798907 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 520/1032] 10.222.0.49 () {56 vars in 1133 bytes} [Sun Aug 21 00:53:46 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:46.799054 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a02d7-c5f6-4bfb-9284-d85792175a4b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:46.799054 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec0a02d7-c5f6-4bfb-9284-d85792175a4b None admin] PATH_INFO: `/v3/services/image` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:46.799287 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765f51d-4eb6-4e24-a4a5-3589de4074c9 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:46.799402 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a02d7-c5f6-4bfb-9284-d85792175a4b None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:46.799402 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ec0a02d7-c5f6-4bfb-9284-d85792175a4b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:46.814507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ec0a02d7-c5f6-4bfb-9284-d85792175a4b None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 00:53:46.814507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:46.814507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:53:46.814507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:53:46.814507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:53:46.814507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:53:46.814507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:53:46.814507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:46.814507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 00:53:46.814507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:46.814507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:53:46.814507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:46.814507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:46.814507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:46.814507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:46.814507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:46.814507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:46.817019 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:46.817019 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:46.817019 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:46.817019 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:46.817019 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:46.817019 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:46.817019 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:53:46.817019 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:53:46.817019 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:53:46.817019 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:53:46.817019 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:46.817019 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:46.817019 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:46.817019 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:46.817019 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:46.817019 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:46.818364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:46.818364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:46.818364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:46.818364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:46.818364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:46.818364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:46.818364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:46.818364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:46.818364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:46.818364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:46.818364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:53:46.818364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:46.818364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 00:53:46.818364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:46.818364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 513/1033] 10.222.0.49 () {56 vars in 1105 bytes} [Sun Aug 21 00:53:46 2022] GET /identity/v3/services/image => generated 86 bytes in 265 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:53:46.819866 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a02d7-c5f6-4bfb-9284-d85792175a4b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:46.902868 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:46.924507 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8765f51d-4eb6-4e24-a4a5-3589de4074c9 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:46.968191 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21920bfd-a5b4-4cd9-9670-3fe9cddb7bf3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:46.969106 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21920bfd-a5b4-4cd9-9670-3fe9cddb7bf3 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:46.969106 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21920bfd-a5b4-4cd9-9670-3fe9cddb7bf3 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:46.969400 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21920bfd-a5b4-4cd9-9670-3fe9cddb7bf3 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:46.970558 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21920bfd-a5b4-4cd9-9670-3fe9cddb7bf3 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:46.972289 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21920bfd-a5b4-4cd9-9670-3fe9cddb7bf3 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:46.973961 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 521/1034] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:46 2022] GET /identity/v3/domains/default => generated 199 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:46.974740 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21920bfd-a5b4-4cd9-9670-3fe9cddb7bf3 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:46.991933 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec0a02d7-c5f6-4bfb-9284-d85792175a4b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:47.037686 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d7012-7181-43db-9ec4-f24949a9b332 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:47.038631 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d7012-7181-43db-9ec4-f24949a9b332 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:47.039107 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d7012-7181-43db-9ec4-f24949a9b332 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:47.039580 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d90d7012-7181-43db-9ec4-f24949a9b332 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:47.060974 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:47.126908 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21920bfd-a5b4-4cd9-9670-3fe9cddb7bf3 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:47.160810 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d7012-7181-43db-9ec4-f24949a9b332 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:47.163273 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fe31c-bacf-44b4-8cef-9ef2f34a2372 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:47.163804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d90d7012-7181-43db-9ec4-f24949a9b332 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:47.163950 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fe31c-bacf-44b4-8cef-9ef2f34a2372 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:47.164147 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fe31c-bacf-44b4-8cef-9ef2f34a2372 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:47.164416 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed9fe31c-bacf-44b4-8cef-9ef2f34a2372 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:47.165081 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fe31c-bacf-44b4-8cef-9ef2f34a2372 None admin] RBAC: Adding query filter params (name=image) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:47.165387 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fe31c-bacf-44b4-8cef-9ef2f34a2372 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:47.166793 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed9fe31c-bacf-44b4-8cef-9ef2f34a2372 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:47.174223 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 522/1035] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:46 2022] GET /identity/v3/services?name=image => generated 122 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:47.175580 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fe31c-bacf-44b4-8cef-9ef2f34a2372 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:47.200828 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:47.313295 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 514/1036] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:53:46 2022] GET /identity/v3/auth/tokens => generated 1969 bytes in 496 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:53:47.314587 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d7012-7181-43db-9ec4-f24949a9b332 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:47.352874 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed9fe31c-bacf-44b4-8cef-9ef2f34a2372 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:47.365275 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:47.408980 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8ff91-a91f-4239-a412-1984c158c788 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:47.408980 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8ff91-a91f-4239-a412-1984c158c788 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:47.409456 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8ff91-a91f-4239-a412-1984c158c788 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:47.409709 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01d8ff91-a91f-4239-a412-1984c158c788 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:47.410211 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8ff91-a91f-4239-a412-1984c158c788 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:47.411805 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01d8ff91-a91f-4239-a412-1984c158c788 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:47.438601 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 523/1037] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 21 00:53:47 2022] POST /identity/v3/users => generated 285 bytes in 264 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:53:47.439476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8ff91-a91f-4239-a412-1984c158c788 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:47.446428 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d90d7012-7181-43db-9ec4-f24949a9b332 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:47.513073 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d84c8b-e773-4fda-a3df-d6ad6049f6c1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:47.514004 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d84c8b-e773-4fda-a3df-d6ad6049f6c1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:47.514457 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d84c8b-e773-4fda-a3df-d6ad6049f6c1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:47.514904 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b6d84c8b-e773-4fda-a3df-d6ad6049f6c1 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:47.515986 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d84c8b-e773-4fda-a3df-d6ad6049f6c1 None admin] RBAC: Adding query filter params (type=image) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:47.516486 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d84c8b-e773-4fda-a3df-d6ad6049f6c1 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:47.519005 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b6d84c8b-e773-4fda-a3df-d6ad6049f6c1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:47.528009 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 515/1038] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:47 2022] GET /identity/v3/services?type=image => generated 350 bytes in 214 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:47.537271 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d84c8b-e773-4fda-a3df-d6ad6049f6c1 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:47.580763 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:47.643319 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01d8ff91-a91f-4239-a412-1984c158c788 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:47.701973 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e974544-896e-4299-9d7e-b20c5cd13a4a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:47.702669 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e974544-896e-4299-9d7e-b20c5cd13a4a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:47.702950 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e974544-896e-4299-9d7e-b20c5cd13a4a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:47.703223 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e974544-896e-4299-9d7e-b20c5cd13a4a None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:47.716300 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e974544-896e-4299-9d7e-b20c5cd13a4a None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:47.717829 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6e974544-896e-4299-9d7e-b20c5cd13a4a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:47.720443 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b6d84c8b-e773-4fda-a3df-d6ad6049f6c1 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:47.734064 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-6e974544-896e-4299-9d7e-b20c5cd13a4a None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:47.734064 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:47.734064 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:47.734064 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:47.734064 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:47.734064 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:47.734064 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:47.734064 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:47.734064 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:47.734064 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:47.734064 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:47.734064 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:47.734064 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:47.734064 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:47.734064 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:47.734064 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:47.736154 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:47.736154 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:47.736154 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:47.736154 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:47.736154 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:47.736154 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:47.736154 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:47.736154 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:47.736154 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:47.736154 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:47.736154 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:47.736154 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:47.736154 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:47.736154 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:47.736154 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:47.736154 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:47.736154 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:47.738070 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:47.738070 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:47.738070 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:47.738070 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 524/1039] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:47 2022] GET /identity/v3/domains/Default => generated 87 bytes in 297 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:47.739109 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:47.744585 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e974544-896e-4299-9d7e-b20c5cd13a4a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:47.782870 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e441982-ad72-4aab-a05f-5fc6440e7940 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:47.783709 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e441982-ad72-4aab-a05f-5fc6440e7940 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:47.784140 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e441982-ad72-4aab-a05f-5fc6440e7940 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:47.784590 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e441982-ad72-4aab-a05f-5fc6440e7940 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:47.785687 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e441982-ad72-4aab-a05f-5fc6440e7940 None admin] RBAC: Adding query filter params (interface=public, service_id=f9f7bd35b7d5407dbf810c6086fcf54b, region_id=RegionOne) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:47.786117 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e441982-ad72-4aab-a05f-5fc6440e7940 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:47.787974 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e441982-ad72-4aab-a05f-5fc6440e7940 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:47.805887 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 516/1040] 10.222.0.49 () {56 vars in 1251 bytes} [Sun Aug 21 00:53:47 2022] GET /identity/v3/endpoints?service_id=f9f7bd35b7d5407dbf810c6086fcf54b&interface=public®ion_id=RegionOne => generated 194 bytes in 269 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:47.813660 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e441982-ad72-4aab-a05f-5fc6440e7940 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:47.933883 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6e974544-896e-4299-9d7e-b20c5cd13a4a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:47.973794 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e441982-ad72-4aab-a05f-5fc6440e7940 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:47.978108 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:47.998753 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df122c3-b5dc-4b45-b8e2-7ed404d5289f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:47.999594 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df122c3-b5dc-4b45-b8e2-7ed404d5289f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:48.000122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df122c3-b5dc-4b45-b8e2-7ed404d5289f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:48.000122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3df122c3-b5dc-4b45-b8e2-7ed404d5289f None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:48.001328 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df122c3-b5dc-4b45-b8e2-7ed404d5289f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:48.001658 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df122c3-b5dc-4b45-b8e2-7ed404d5289f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:48.003128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3df122c3-b5dc-4b45-b8e2-7ed404d5289f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:48.019596 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 525/1041] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:47 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 275 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:48.025427 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df122c3-b5dc-4b45-b8e2-7ed404d5289f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:48.025911 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9cfae7-a1fb-4cc0-b6d1-1b4e064daedb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:48.026708 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9cfae7-a1fb-4cc0-b6d1-1b4e064daedb None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:48.027037 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9cfae7-a1fb-4cc0-b6d1-1b4e064daedb None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:48.027386 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e9cfae7-a1fb-4cc0-b6d1-1b4e064daedb None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:48.028074 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9cfae7-a1fb-4cc0-b6d1-1b4e064daedb None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:48.029650 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5e9cfae7-a1fb-4cc0-b6d1-1b4e064daedb None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:48.038860 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 517/1042] 10.222.0.49 () {56 vars in 1087 bytes} [Sun Aug 21 00:53:47 2022] GET /identity/v3/services => generated 1957 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 00:53:48.251240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3df122c3-b5dc-4b45-b8e2-7ed404d5289f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:48.305660 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea4601-17e9-4223-8a85-0af98f764eb0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:48.306565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea4601-17e9-4223-8a85-0af98f764eb0 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:48.307033 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea4601-17e9-4223-8a85-0af98f764eb0 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:48.307492 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-69ea4601-17e9-4223-8a85-0af98f764eb0 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:48.320579 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea4601-17e9-4223-8a85-0af98f764eb0 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:48.323535 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-69ea4601-17e9-4223-8a85-0af98f764eb0 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:48.345143 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-69ea4601-17e9-4223-8a85-0af98f764eb0 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:48.345143 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:48.345143 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:48.345143 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:48.345143 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:48.345143 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:48.345143 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:48.345143 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:48.345143 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:48.345143 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:48.345143 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:48.345143 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:48.345143 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:53:48.345143 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:53:48.345143 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:53:48.346150 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:53:48.346150 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:48.346150 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:48.346150 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:48.346150 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:48.346150 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:48.346150 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:48.346150 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:48.346150 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:48.346150 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:48.346150 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:48.346150 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:48.346150 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:48.346150 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:48.346150 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:48.346150 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:48.346150 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:48.347096 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:53:48.347096 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:53:48.347096 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:53:48.347096 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:53:48.347096 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:53:48.347096 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:53:48.347096 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:48.347096 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:48.348002 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 526/1043] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:53:48 2022] GET /identity/v3/projects/service => generated 88 bytes in 323 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:53:48.357571 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9cfae7-a1fb-4cc0-b6d1-1b4e064daedb None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:48.419008 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:48.543131 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e9cfae7-a1fb-4cc0-b6d1-1b4e064daedb None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:48.609675 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f58c7c3b-736a-4d68-815e-c8f2e24b52dd None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:48.610701 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c7c3b-736a-4d68-815e-c8f2e24b52dd None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:48.611172 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c7c3b-736a-4d68-815e-c8f2e24b52dd None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:48.611720 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f58c7c3b-736a-4d68-815e-c8f2e24b52dd None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:48.612994 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c7c3b-736a-4d68-815e-c8f2e24b52dd None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:48.613548 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c7c3b-736a-4d68-815e-c8f2e24b52dd None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:48.616231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f58c7c3b-736a-4d68-815e-c8f2e24b52dd None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:48.645080 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 518/1044] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:53:48 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:48.648612 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea4601-17e9-4223-8a85-0af98f764eb0 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:48.732643 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:48.845886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-69ea4601-17e9-4223-8a85-0af98f764eb0 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:48.907634 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78517e2-dadf-4777-93ff-1d6e0f392e08 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:48.908643 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78517e2-dadf-4777-93ff-1d6e0f392e08 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:48.909140 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78517e2-dadf-4777-93ff-1d6e0f392e08 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:48.909619 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78517e2-dadf-4777-93ff-1d6e0f392e08 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:48.910993 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78517e2-dadf-4777-93ff-1d6e0f392e08 None admin] RBAC: Adding query filter params (role.id=bfc1c16a629c46a0883a2f7363d940cf, scope.project.id=838e996d09a0454b9bcdc5aef03ef203, user.id=6b003ae4a082485ab608bf84c1657159) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:48.911549 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78517e2-dadf-4777-93ff-1d6e0f392e08 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:48.914436 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78517e2-dadf-4777-93ff-1d6e0f392e08 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:48.933092 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 527/1045] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:53:48 2022] GET /identity/v3/role_assignments?user.id=6b003ae4a082485ab608bf84c1657159&scope.project.id=838e996d09a0454b9bcdc5aef03ef203&role.id=bfc1c16a629c46a0883a2f7363d940cf => generated 259 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:50.113081 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba6a05-5150-4158-8291-8430db76ce0d None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:50.113620 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba6a05-5150-4158-8291-8430db76ce0d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:50.114084 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-83ba6a05-5150-4158-8291-8430db76ce0d None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:50.116625 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 519/1046] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:50 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:50.123750 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332692ad-b3db-4fed-9459-4f388980a385 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:50.124275 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332692ad-b3db-4fed-9459-4f388980a385 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:50.124857 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332692ad-b3db-4fed-9459-4f388980a385 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:50.155503 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-332692ad-b3db-4fed-9459-4f388980a385 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:50.157586 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-332692ad-b3db-4fed-9459-4f388980a385 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:50.273470 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 528/1047] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 151 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:50.320077 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6e094-91b4-4db8-bfe4-165562e0ecf4 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:50.320434 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6e094-91b4-4db8-bfe4-165562e0ecf4 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:50.320985 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b8a6e094-91b4-4db8-bfe4-165562e0ecf4 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:50.322722 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 520/1048] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:50.331866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd27310-f648-4c50-a64e-15310e2f046e None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:50.332354 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd27310-f648-4c50-a64e-15310e2f046e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:50.332814 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6cd27310-f648-4c50-a64e-15310e2f046e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:50.363972 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-6cd27310-f648-4c50-a64e-15310e2f046e None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:50.365905 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-6cd27310-f648-4c50-a64e-15310e2f046e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:50.419350 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:50.486216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 529/1049] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:50 2022] POST /identity/v3/auth/tokens => generated 1969 bytes in 156 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:50.690487 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6e094-91b4-4db8-bfe4-165562e0ecf4 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:50.879870 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:50.896507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b8a6e094-91b4-4db8-bfe4-165562e0ecf4 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:50.959068 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d575db-2edf-434c-92a3-3cdba173ccdb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:50.960503 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d575db-2edf-434c-92a3-3cdba173ccdb None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:50.961279 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d575db-2edf-434c-92a3-3cdba173ccdb None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:50.961970 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96d575db-2edf-434c-92a3-3cdba173ccdb None admin] PATH_INFO: `/v3/services/image` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:50.963286 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d575db-2edf-434c-92a3-3cdba173ccdb None admin] RBAC: Authorizing `identity:get_service(service_id=image)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:50.966269 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96d575db-2edf-434c-92a3-3cdba173ccdb None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:50.983936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-96d575db-2edf-434c-92a3-3cdba173ccdb None admin] Could not find service: image.: keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 00:53:50.983936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:50.983936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:53:50.983936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:53:50.983936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:53:50.983936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:53:50.983936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:53:50.983936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:50.983936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 00:53:50.983936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:50.983936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:53:50.983936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:50.983936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:50.983936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:50.983936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:50.983936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:50.983936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:50.986347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:50.986347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:50.986347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:50.986347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:50.986347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:50.986347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:50.986347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:53:50.986347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:53:50.986347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:53:50.986347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:53:50.986347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:50.986347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:50.986347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:50.986347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:50.986347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:50.986347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:50.988056 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:50.988056 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:50.988056 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:50.988056 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:50.988056 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:50.988056 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:50.988056 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:50.988056 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:50.988056 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:50.988056 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:50.988056 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:53:50.988056 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:53:50.988056 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: image. Aug 21 00:53:50.988056 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:50.993435 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd27310-f648-4c50-a64e-15310e2f046e None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:50.993684 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 521/1050] 10.222.0.49 () {56 vars in 1105 bytes} [Sun Aug 21 00:53:50 2022] GET /identity/v3/services/image => generated 86 bytes in 298 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:53:50.998549 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d575db-2edf-434c-92a3-3cdba173ccdb None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:51.179190 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6cd27310-f648-4c50-a64e-15310e2f046e None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:51.203196 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96d575db-2edf-434c-92a3-3cdba173ccdb None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:51.251226 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3593960-3d4e-4f6f-80fd-509cd7ca68e0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:51.252337 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3593960-3d4e-4f6f-80fd-509cd7ca68e0 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:51.253230 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3593960-3d4e-4f6f-80fd-509cd7ca68e0 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:51.253723 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3593960-3d4e-4f6f-80fd-509cd7ca68e0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:51.273295 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d2f25-6e0e-4526-94c9-fac3296f3fef None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:51.274380 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d2f25-6e0e-4526-94c9-fac3296f3fef None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:51.274879 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d2f25-6e0e-4526-94c9-fac3296f3fef None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:51.275370 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-730d2f25-6e0e-4526-94c9-fac3296f3fef None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:51.276591 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d2f25-6e0e-4526-94c9-fac3296f3fef None admin] RBAC: Adding query filter params (name=image) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:51.276756 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f3593960-3d4e-4f6f-80fd-509cd7ca68e0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:53:51.277214 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d2f25-6e0e-4526-94c9-fac3296f3fef None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:51.279898 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-730d2f25-6e0e-4526-94c9-fac3296f3fef None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:51.286410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-f3593960-3d4e-4f6f-80fd-509cd7ca68e0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:53:51.286410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:51.286410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:51.286410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:51.286410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:51.286410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:51.286410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:51.286410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:51.286410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:51.286410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:51.286410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:51.286410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:51.286410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:53:51.286410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:53:51.286410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:53:51.286410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:53:51.288304 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:53:51.288304 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:53:51.288304 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:53:51.288304 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:53:51.288304 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:51.288304 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:51.288304 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:51.288304 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:51.288304 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:51.288304 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:51.288304 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:51.288304 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:51.288304 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:51.288304 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:51.288304 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:51.288304 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:51.291065 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:51.291065 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:51.291065 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:51.291065 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:51.291065 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:53:51.291065 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:53:51.291065 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:53:51.291065 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:53:51.291065 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:53:51.291065 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:53:51.291065 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:53:51.291065 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:51.291065 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 530/1051] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:53:50 2022] GET /identity/v3/roles/admin => generated 83 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:53:51.294424 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 522/1052] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:50 2022] GET /identity/v3/services?name=image => generated 122 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:51.301453 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3593960-3d4e-4f6f-80fd-509cd7ca68e0 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:51.303804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d2f25-6e0e-4526-94c9-fac3296f3fef None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:51.352884 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:51.358887 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:51.505803 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3593960-3d4e-4f6f-80fd-509cd7ca68e0 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:51.510790 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-730d2f25-6e0e-4526-94c9-fac3296f3fef None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:51.573687 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fb53c-3d0f-4fc9-a01e-5a84bc2b5bb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:51.574728 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fb53c-3d0f-4fc9-a01e-5a84bc2b5bb7 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:51.575226 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fb53c-3d0f-4fc9-a01e-5a84bc2b5bb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:51.575722 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d67fb53c-3d0f-4fc9-a01e-5a84bc2b5bb7 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:51.576982 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67fb53c-3d0f-4fc9-a01e-5a84bc2b5bb7 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:51.577569 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67fb53c-3d0f-4fc9-a01e-5a84bc2b5bb7 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:51.579934 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82f594ec-89ab-490f-b283-522f1adf4f34 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:51.580264 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d67fb53c-3d0f-4fc9-a01e-5a84bc2b5bb7 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:51.580981 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f594ec-89ab-490f-b283-522f1adf4f34 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:51.581509 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f594ec-89ab-490f-b283-522f1adf4f34 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:51.581975 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82f594ec-89ab-490f-b283-522f1adf4f34 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:51.583131 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f594ec-89ab-490f-b283-522f1adf4f34 None admin] RBAC: Adding query filter params (type=image) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:51.583668 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f594ec-89ab-490f-b283-522f1adf4f34 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:51.586310 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82f594ec-89ab-490f-b283-522f1adf4f34 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:51.596624 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 523/1053] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:51 2022] GET /identity/v3/services?type=image => generated 350 bytes in 294 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:51.603818 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 531/1054] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:53:51 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 297 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:51.604053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ac2c7-50a6-4a1c-8a6b-5d0efc195477 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:51.604053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ac2c7-50a6-4a1c-8a6b-5d0efc195477 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:51.604053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec9ac2c7-50a6-4a1c-8a6b-5d0efc195477 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:51.604053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 524/1055] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:51 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:51.605392 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fb53c-3d0f-4fc9-a01e-5a84bc2b5bb7 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:51.606369 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ac2c7-50a6-4a1c-8a6b-5d0efc195477 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:51.726855 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:51.755936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ec9ac2c7-50a6-4a1c-8a6b-5d0efc195477 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:51.762694 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:51.786413 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d67fb53c-3d0f-4fc9-a01e-5a84bc2b5bb7 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:51.801386 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5cd34c55-4d9a-42e7-b049-7554446b4071 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:51.802049 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd34c55-4d9a-42e7-b049-7554446b4071 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:51.802324 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd34c55-4d9a-42e7-b049-7554446b4071 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:51.802588 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5cd34c55-4d9a-42e7-b049-7554446b4071 None admin] PATH_INFO: `/v3/users/720ac97c0eb448e6a1ec242e33608160` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:51.837667 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd34c55-4d9a-42e7-b049-7554446b4071 None admin] RBAC: Authorizing `identity:get_user(user_id=720ac97c0eb448e6a1ec242e33608160)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:51.840453 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5cd34c55-4d9a-42e7-b049-7554446b4071 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:51.843705 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 525/1056] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:53:51 2022] GET /identity/v3/users/720ac97c0eb448e6a1ec242e33608160 => generated 285 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:51.846128 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a0486-c33c-41f3-8ee4-e2f8fc66565d None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:51.846615 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a0486-c33c-41f3-8ee4-e2f8fc66565d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:51.847096 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-647a0486-c33c-41f3-8ee4-e2f8fc66565d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:51.860941 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd44552-5ecc-46ea-82a2-e5c158aaee50 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:51.861725 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd44552-5ecc-46ea-82a2-e5c158aaee50 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:51.862125 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd44552-5ecc-46ea-82a2-e5c158aaee50 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:51.862398 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cd44552-5ecc-46ea-82a2-e5c158aaee50 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:51.863410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd44552-5ecc-46ea-82a2-e5c158aaee50 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:51.864989 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cd44552-5ecc-46ea-82a2-e5c158aaee50 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:51.877818 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-647a0486-c33c-41f3-8ee4-e2f8fc66565d None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:51.879932 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-647a0486-c33c-41f3-8ee4-e2f8fc66565d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:51.893135 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 532/1057] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 21 00:53:51 2022] POST /identity/v3/endpoints => generated 327 bytes in 289 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:53:51.893913 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd44552-5ecc-46ea-82a2-e5c158aaee50 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:52.022556 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 526/1058] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:52.095962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cd44552-5ecc-46ea-82a2-e5c158aaee50 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:52.160077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07071df9-8a14-4c0f-8278-aa19db8b756f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:52.160805 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07071df9-8a14-4c0f-8278-aa19db8b756f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:52.161191 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07071df9-8a14-4c0f-8278-aa19db8b756f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:52.161521 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07071df9-8a14-4c0f-8278-aa19db8b756f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:52.186904 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:52.299899 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07071df9-8a14-4c0f-8278-aa19db8b756f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:52.302500 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07071df9-8a14-4c0f-8278-aa19db8b756f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:52.445221 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a0486-c33c-41f3-8ee4-e2f8fc66565d None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:52.496287 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 533/1059] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:53:51 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 603 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:53:52.505348 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07071df9-8a14-4c0f-8278-aa19db8b756f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:52.552470 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:52.592336 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:52.616352 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-647a0486-c33c-41f3-8ee4-e2f8fc66565d None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:52.685617 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9e6ae-1a89-4d13-b5b2-5fafd08dd97c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:52.686990 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9e6ae-1a89-4d13-b5b2-5fafd08dd97c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:52.687639 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9e6ae-1a89-4d13-b5b2-5fafd08dd97c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:52.688130 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87b9e6ae-1a89-4d13-b5b2-5fafd08dd97c None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:52.703588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07071df9-8a14-4c0f-8278-aa19db8b756f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:52.709687 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87b9e6ae-1a89-4d13-b5b2-5fafd08dd97c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:53:52.719090 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-87b9e6ae-1a89-4d13-b5b2-5fafd08dd97c None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:53:52.719090 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:52.719090 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:52.719090 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:52.719090 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:52.719090 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:52.719090 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:52.719090 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:52.719090 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:52.719090 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:52.719090 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:52.719090 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:52.719090 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:53:52.719090 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:53:52.719090 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:53:52.719090 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:53:52.720914 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:53:52.720914 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:53:52.720914 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:53:52.720914 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:53:52.720914 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:52.720914 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:52.720914 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:52.720914 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:52.720914 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:52.720914 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:52.720914 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:52.720914 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:52.720914 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:52.720914 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:52.720914 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:52.720914 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:52.722493 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:52.722493 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:52.722493 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:52.722493 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:52.722493 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:53:52.722493 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:53:52.722493 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:53:52.722493 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:53:52.722493 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:53:52.722493 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:53:52.722493 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:53:52.722493 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:52.728479 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 527/1060] 10.222.0.49 () {56 vars in 1120 bytes} [Sun Aug 21 00:53:52 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 284 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:53:52.731533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9e6ae-1a89-4d13-b5b2-5fafd08dd97c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:52.774977 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add29879-4973-42c0-ab42-1a41f934d41b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:52.776050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add29879-4973-42c0-ab42-1a41f934d41b None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:52.776526 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add29879-4973-42c0-ab42-1a41f934d41b None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:52.776978 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-add29879-4973-42c0-ab42-1a41f934d41b None admin] PATH_INFO: `/v3/projects/e8e27d583fc14060b9ba9f9b94a0500d` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:52.779045 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add29879-4973-42c0-ab42-1a41f934d41b None admin] RBAC: Authorizing `identity:get_project(project_id=e8e27d583fc14060b9ba9f9b94a0500d)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:52.781530 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-add29879-4973-42c0-ab42-1a41f934d41b None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:52.784669 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 534/1061] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:53:52 2022] GET /identity/v3/projects/e8e27d583fc14060b9ba9f9b94a0500d => generated 311 bytes in 280 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:52.794720 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add29879-4973-42c0-ab42-1a41f934d41b None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:52.923447 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87b9e6ae-1a89-4d13-b5b2-5fafd08dd97c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:52.984517 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:52.991683 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-add29879-4973-42c0-ab42-1a41f934d41b None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:52.995826 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ae059-9dd4-48f6-baae-f09b0a9be7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:52.996888 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ae059-9dd4-48f6-baae-f09b0a9be7a8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:52.997376 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ae059-9dd4-48f6-baae-f09b0a9be7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:52.997854 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-434ae059-9dd4-48f6-baae-f09b0a9be7a8 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:52.999100 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ae059-9dd4-48f6-baae-f09b0a9be7a8 None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:52.999630 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ae059-9dd4-48f6-baae-f09b0a9be7a8 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:53.002648 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-434ae059-9dd4-48f6-baae-f09b0a9be7a8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:53.019571 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 528/1062] 10.222.0.49 () {56 vars in 1115 bytes} [Sun Aug 21 00:53:52 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:53.021213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:53.029228 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ae059-9dd4-48f6-baae-f09b0a9be7a8 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:53.064769 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f2eee-d543-45ba-b98c-beb96b013bb9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:53.065952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f2eee-d543-45ba-b98c-beb96b013bb9 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:53.066587 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f2eee-d543-45ba-b98c-beb96b013bb9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:53.066975 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f4f2eee-d543-45ba-b98c-beb96b013bb9 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:53.068372 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f2eee-d543-45ba-b98c-beb96b013bb9 None admin] RBAC: Adding query filter params (role.id=c73e9539582145ed8eedc48648b9d738, scope.project.id=e8e27d583fc14060b9ba9f9b94a0500d, user.id=720ac97c0eb448e6a1ec242e33608160) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:53.068921 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f2eee-d543-45ba-b98c-beb96b013bb9 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:53.072346 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f4f2eee-d543-45ba-b98c-beb96b013bb9 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:53.093094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 535/1063] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:53:52 2022] GET /identity/v3/role_assignments?user.id=720ac97c0eb448e6a1ec242e33608160&scope.project.id=e8e27d583fc14060b9ba9f9b94a0500d&role.id=c73e9539582145ed8eedc48648b9d738 => generated 259 bytes in 290 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:53.247397 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-434ae059-9dd4-48f6-baae-f09b0a9be7a8 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:53.298901 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fb7f0-9bce-4907-8387-b05e9fa16000 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:53.299548 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fb7f0-9bce-4907-8387-b05e9fa16000 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:53.299875 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fb7f0-9bce-4907-8387-b05e9fa16000 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:53.300148 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-377fb7f0-9bce-4907-8387-b05e9fa16000 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:53.315212 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fb7f0-9bce-4907-8387-b05e9fa16000 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:53.316855 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-377fb7f0-9bce-4907-8387-b05e9fa16000 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:53.334654 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-377fb7f0-9bce-4907-8387-b05e9fa16000 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:53.334654 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:53.334654 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:53.334654 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:53.334654 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:53.334654 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:53.334654 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:53.334654 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:53.334654 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:53.334654 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:53.334654 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:53.334654 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:53.334654 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:53.334654 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:53.334654 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:53.334654 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:53.336478 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:53.336478 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:53.336478 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:53.336478 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:53.336478 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:53.336478 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:53.336478 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:53.336478 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:53.336478 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:53.336478 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:53.336478 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:53.336478 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:53.336478 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:53.336478 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:53.336478 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:53.336478 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:53.336478 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:53.338275 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:53.338275 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:53.338275 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:53.338275 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 529/1064] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:53 2022] GET /identity/v3/domains/Default => generated 87 bytes in 308 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:53.349323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f2eee-d543-45ba-b98c-beb96b013bb9 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:53.536353 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f4f2eee-d543-45ba-b98c-beb96b013bb9 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:53.598633 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30dab87-776f-42da-af61-bbb8e6eed01f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:53.599683 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dab87-776f-42da-af61-bbb8e6eed01f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:53.600167 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dab87-776f-42da-af61-bbb8e6eed01f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:53.600638 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d30dab87-776f-42da-af61-bbb8e6eed01f None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:53.601882 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30dab87-776f-42da-af61-bbb8e6eed01f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:53.602455 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30dab87-776f-42da-af61-bbb8e6eed01f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:53.605341 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d30dab87-776f-42da-af61-bbb8e6eed01f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:53.634155 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 536/1065] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:53 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 281 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:53.636554 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fb7f0-9bce-4907-8387-b05e9fa16000 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:53.718910 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:53.811600 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-377fb7f0-9bce-4907-8387-b05e9fa16000 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:53.871842 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07f099e9-c39c-42c0-81b7-adfe1a3abf9b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:53.872885 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f099e9-c39c-42c0-81b7-adfe1a3abf9b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:53.873380 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f099e9-c39c-42c0-81b7-adfe1a3abf9b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:53.873866 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07f099e9-c39c-42c0-81b7-adfe1a3abf9b None admin] PATH_INFO: `/v3/users/nova` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:53.890998 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f099e9-c39c-42c0-81b7-adfe1a3abf9b None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:53.891907 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07f099e9-c39c-42c0-81b7-adfe1a3abf9b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:53.909776 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-07f099e9-c39c-42c0-81b7-adfe1a3abf9b None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:53:53.909776 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:53.909776 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:53.909776 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:53.909776 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:53.909776 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:53.909776 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:53.909776 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:53.909776 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:53.909776 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:53.909776 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:53.909776 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:53.909776 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:53:53.909776 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:53:53.909776 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:53:53.909776 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:53:53.911098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:53.911098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:53.911098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:53:53.911098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:53.911098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:53:53.911098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:53.911098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:53.911098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:53.911098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:53.911098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:53.911098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:53.911098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:53.911098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:53.911098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:53.911098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:53.911098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:53.911098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:53.911098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:53.919205 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:53.919205 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:53.919205 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:53:53.919205 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:53:53.919205 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:53:53.919205 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:53:53.919205 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:53:53.919205 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:53:53.919205 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:53:53.919205 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:53.919205 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 530/1066] 10.222.0.49 () {56 vars in 1093 bytes} [Sun Aug 21 00:53:53 2022] GET /identity/v3/users/nova => generated 82 bytes in 276 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:53.923817 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30dab87-776f-42da-af61-bbb8e6eed01f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:53.974074 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:54.083458 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d30dab87-776f-42da-af61-bbb8e6eed01f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:54.103262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332efeea-83ea-414f-b25d-3a4322353930 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:54.103710 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332efeea-83ea-414f-b25d-3a4322353930 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:54.104161 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-332efeea-83ea-414f-b25d-3a4322353930 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:54.106546 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 531/1067] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:54 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:53:54.115300 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08c139-40df-4eb0-816c-36d3e1499a9e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:54.115789 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08c139-40df-4eb0-816c-36d3e1499a9e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:54.116255 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db08c139-40df-4eb0-816c-36d3e1499a9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:54.130710 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97227240-01bf-48af-8145-cc4b3785fcd9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:54.131501 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97227240-01bf-48af-8145-cc4b3785fcd9 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:54.131779 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97227240-01bf-48af-8145-cc4b3785fcd9 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:54.132252 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97227240-01bf-48af-8145-cc4b3785fcd9 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:54.133447 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97227240-01bf-48af-8145-cc4b3785fcd9 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:54.133759 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97227240-01bf-48af-8145-cc4b3785fcd9 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:54.135303 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97227240-01bf-48af-8145-cc4b3785fcd9 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:54.138397 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-db08c139-40df-4eb0-816c-36d3e1499a9e None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:54.140610 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-db08c139-40df-4eb0-816c-36d3e1499a9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:54.159959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 537/1068] 10.222.0.49 () {56 vars in 1133 bytes} [Sun Aug 21 00:53:53 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 237 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:54.165936 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97227240-01bf-48af-8145-cc4b3785fcd9 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:54.259101 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 532/1069] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:54 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 145 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:53:54.311798 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:54.325822 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97227240-01bf-48af-8145-cc4b3785fcd9 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:54.391047 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4b770-30b6-49ab-9f97-bdb1764ebfa1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:54.392008 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4b770-30b6-49ab-9f97-bdb1764ebfa1 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:54.392397 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4b770-30b6-49ab-9f97-bdb1764ebfa1 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:54.392838 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4a4b770-30b6-49ab-9f97-bdb1764ebfa1 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:54.412267 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4b770-30b6-49ab-9f97-bdb1764ebfa1 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:54.414690 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f4a4b770-30b6-49ab-9f97-bdb1764ebfa1 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:54.443391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-f4a4b770-30b6-49ab-9f97-bdb1764ebfa1 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:54.443391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:54.443391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:54.443391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:54.443391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:54.443391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:54.443391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:54.443391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:54.443391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:54.443391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:54.443391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:54.443391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:54.443391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:54.443391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:54.443391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:54.443391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:54.445798 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:54.445798 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:54.445798 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:54.445798 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:54.445798 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:54.445798 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:54.445798 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:54.445798 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:54.445798 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:54.445798 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:54.445798 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:54.445798 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:54.445798 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:54.445798 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:54.445798 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:54.445798 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:54.445798 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:54.447663 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:54.447663 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:54.447663 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:54.447663 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 538/1070] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:54 2022] GET /identity/v3/domains/Default => generated 87 bytes in 280 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:53:54.451927 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08c139-40df-4eb0-816c-36d3e1499a9e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:54.511909 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:54.601903 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4b770-30b6-49ab-9f97-bdb1764ebfa1 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:54.606973 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db08c139-40df-4eb0-816c-36d3e1499a9e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:54.653386 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b506de-9732-4fbd-84ab-a4f883789b12 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:54.654376 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b506de-9732-4fbd-84ab-a4f883789b12 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:54.654771 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b506de-9732-4fbd-84ab-a4f883789b12 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:54.655087 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0b506de-9732-4fbd-84ab-a4f883789b12 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:54.655974 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b506de-9732-4fbd-84ab-a4f883789b12 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:54.656352 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b506de-9732-4fbd-84ab-a4f883789b12 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:54.658522 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c0b506de-9732-4fbd-84ab-a4f883789b12 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:54.685855 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 533/1071] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:54 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:54.687841 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b506de-9732-4fbd-84ab-a4f883789b12 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:54.778580 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f4a4b770-30b6-49ab-9f97-bdb1764ebfa1 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:54.824312 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcf315-593f-4c56-b6d2-71ac0d9e5767 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:54.824922 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcf315-593f-4c56-b6d2-71ac0d9e5767 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:54.825244 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcf315-593f-4c56-b6d2-71ac0d9e5767 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:54.825497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64bcf315-593f-4c56-b6d2-71ac0d9e5767 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:54.842413 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:54.846357 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:54.856399 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0b506de-9732-4fbd-84ab-a4f883789b12 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:54.914108 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f6249-34b3-46c6-9333-b686c08a0a54 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:54.914525 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f6249-34b3-46c6-9333-b686c08a0a54 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:54.914799 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f6249-34b3-46c6-9333-b686c08a0a54 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:54.915059 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a49f6249-34b3-46c6-9333-b686c08a0a54 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:54.922367 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f6249-34b3-46c6-9333-b686c08a0a54 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:54.923837 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a49f6249-34b3-46c6-9333-b686c08a0a54 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:54.941069 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bcf315-593f-4c56-b6d2-71ac0d9e5767 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:54.943784 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64bcf315-593f-4c56-b6d2-71ac0d9e5767 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:54.948313 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-a49f6249-34b3-46c6-9333-b686c08a0a54 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:54.948313 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:54.948313 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:54.948313 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:54.948313 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:54.948313 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:54.948313 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:54.948313 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:54.948313 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:54.948313 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:54.948313 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:54.948313 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:54.948313 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:53:54.948313 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:53:54.948313 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:53:54.949452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:53:54.949452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:54.949452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:54.949452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:54.949452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:54.949452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:54.949452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:54.949452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:54.949452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:54.949452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:54.949452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:54.949452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:54.949452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:54.949452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:54.949452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:54.949452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:54.949452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:54.956819 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:53:54.956819 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:53:54.956819 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:53:54.956819 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:53:54.956819 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:53:54.956819 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:53:54.956819 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:53:54.956819 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:54.956819 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 534/1072] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:53:54 2022] GET /identity/v3/projects/service => generated 88 bytes in 263 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:53:54.956819 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f6249-34b3-46c6-9333-b686c08a0a54 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:55.096429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 539/1073] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:53:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 495 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:53:55.102095 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a49f6249-34b3-46c6-9333-b686c08a0a54 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:55.105554 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcf315-593f-4c56-b6d2-71ac0d9e5767 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:55.161094 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-05d41627-2005-4256-8c68-021868dc125e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:55.162060 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d41627-2005-4256-8c68-021868dc125e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:55.162493 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d41627-2005-4256-8c68-021868dc125e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:55.162911 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-05d41627-2005-4256-8c68-021868dc125e None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:55.164068 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d41627-2005-4256-8c68-021868dc125e None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:55.164614 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d41627-2005-4256-8c68-021868dc125e None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:55.167145 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-05d41627-2005-4256-8c68-021868dc125e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:55.179299 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:55.185216 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 535/1074] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:53:54 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 230 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:55.187115 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf08c8-09b5-4fa6-8c58-4d7e363be948 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:55.187462 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf08c8-09b5-4fa6-8c58-4d7e363be948 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:55.187816 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71cf08c8-09b5-4fa6-8c58-4d7e363be948 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:55.193105 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 536/1075] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:55 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:55.196576 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf08c8-09b5-4fa6-8c58-4d7e363be948 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:55.221075 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:55.263175 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64bcf315-593f-4c56-b6d2-71ac0d9e5767 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:55.322642 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8cc27da8-7dfc-4f41-a1ad-8d26ac124b77 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:55.323814 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc27da8-7dfc-4f41-a1ad-8d26ac124b77 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:55.324301 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc27da8-7dfc-4f41-a1ad-8d26ac124b77 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:55.324759 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8cc27da8-7dfc-4f41-a1ad-8d26ac124b77 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:55.334544 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71cf08c8-09b5-4fa6-8c58-4d7e363be948 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:55.338668 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc27da8-7dfc-4f41-a1ad-8d26ac124b77 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:55.340366 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8cc27da8-7dfc-4f41-a1ad-8d26ac124b77 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:55.362848 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-8cc27da8-7dfc-4f41-a1ad-8d26ac124b77 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:55.362848 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:55.362848 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:55.362848 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:55.362848 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:55.362848 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:55.362848 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:55.362848 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:55.362848 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:55.362848 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:55.362848 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:55.362848 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:55.362848 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:55.362848 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:55.362848 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:55.362848 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:55.363888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:55.363888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:55.363888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:55.363888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:55.363888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:55.363888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:55.363888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:55.363888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:55.363888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:55.363888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:55.363888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:55.363888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:55.363888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:55.363888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:55.363888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:55.363888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:55.363888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:55.364779 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:55.364779 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:55.364779 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:55.364779 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 540/1076] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:55 2022] GET /identity/v3/domains/Default => generated 87 bytes in 260 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:53:55.366986 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5451a-306d-498d-8ba0-87a00979bcee None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:55.367491 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5451a-306d-498d-8ba0-87a00979bcee None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:55.367940 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8e5451a-306d-498d-8ba0-87a00979bcee None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:55.379781 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf25328-290a-4aca-878b-f765493f458a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:55.380426 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf25328-290a-4aca-878b-f765493f458a None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:55.380700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf25328-290a-4aca-878b-f765493f458a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:55.380971 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bf25328-290a-4aca-878b-f765493f458a None admin] PATH_INFO: `/v3/projects/838e996d09a0454b9bcdc5aef03ef203/users/6b003ae4a082485ab608bf84c1657159/roles/bfc1c16a629c46a0883a2f7363d940cf` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:55.383226 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf25328-290a-4aca-878b-f765493f458a None admin] RBAC: Authorizing `identity:create_grant(project_id=838e996d09a0454b9bcdc5aef03ef203, user_id=6b003ae4a082485ab608bf84c1657159, role_id=bfc1c16a629c46a0883a2f7363d940cf)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:55.384657 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bf25328-290a-4aca-878b-f765493f458a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:55.396235 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-c8e5451a-306d-498d-8ba0-87a00979bcee None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:55.398353 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c8e5451a-306d-498d-8ba0-87a00979bcee None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:55.401626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 537/1077] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 21 00:53:55 2022] PUT /identity/v3/projects/838e996d09a0454b9bcdc5aef03ef203/users/6b003ae4a082485ab608bf84c1657159/roles/bfc1c16a629c46a0883a2f7363d940cf => generated 0 bytes in 206 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 00:53:55.411894 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf25328-290a-4aca-878b-f765493f458a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:55.533134 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 541/1078] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:55 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 163 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:55.568006 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:55.614188 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bf25328-290a-4aca-878b-f765493f458a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:55.680325 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dec329-67aa-4f88-af6d-0de1239982c5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:55.682062 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dec329-67aa-4f88-af6d-0de1239982c5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:55.682465 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dec329-67aa-4f88-af6d-0de1239982c5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:55.682905 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8dec329-67aa-4f88-af6d-0de1239982c5 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:55.683716 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dec329-67aa-4f88-af6d-0de1239982c5 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:55.684106 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dec329-67aa-4f88-af6d-0de1239982c5 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:55.685656 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8dec329-67aa-4f88-af6d-0de1239982c5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:55.700089 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 538/1079] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:55 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 298 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:55.822606 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5451a-306d-498d-8ba0-87a00979bcee None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:55.857032 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:55.992671 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8e5451a-306d-498d-8ba0-87a00979bcee None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:56.051716 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fa8c0-995f-4654-9a8b-9e55432d21de None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:56.052803 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fa8c0-995f-4654-9a8b-9e55432d21de None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:56.053333 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fa8c0-995f-4654-9a8b-9e55432d21de None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:56.053802 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-866fa8c0-995f-4654-9a8b-9e55432d21de None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:56.073083 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-866fa8c0-995f-4654-9a8b-9e55432d21de None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:53:56.081826 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-866fa8c0-995f-4654-9a8b-9e55432d21de None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:53:56.081826 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:56.081826 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:56.081826 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:56.081826 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:56.081826 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:56.081826 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:56.081826 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:56.081826 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:56.081826 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:56.081826 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:56.081826 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:56.081826 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:53:56.081826 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:53:56.081826 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:53:56.081826 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:53:56.083822 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:53:56.083822 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:53:56.083822 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:53:56.083822 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:53:56.083822 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:56.083822 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:56.083822 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:56.083822 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:56.083822 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:56.083822 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:56.083822 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:56.083822 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:56.083822 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:56.083822 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:56.083822 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:56.083822 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:56.085834 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:56.085834 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:56.085834 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:56.085834 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:56.085834 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:53:56.085834 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:53:56.085834 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:53:56.085834 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:53:56.085834 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:53:56.085834 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:53:56.085834 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:53:56.085834 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:56.085834 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 542/1080] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:53:55 2022] GET /identity/v3/roles/admin => generated 83 bytes in 262 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:56.093018 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dec329-67aa-4f88-af6d-0de1239982c5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:56.258775 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8dec329-67aa-4f88-af6d-0de1239982c5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:56.317127 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb277731-d910-4209-a1de-d5a786ca9cca None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:56.318205 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb277731-d910-4209-a1de-d5a786ca9cca None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:56.318721 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb277731-d910-4209-a1de-d5a786ca9cca None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:56.319181 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb277731-d910-4209-a1de-d5a786ca9cca None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:56.320437 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb277731-d910-4209-a1de-d5a786ca9cca None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:56.321087 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb277731-d910-4209-a1de-d5a786ca9cca None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:56.323731 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb277731-d910-4209-a1de-d5a786ca9cca None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:56.328221 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:56.342923 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 539/1081] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:53:56 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 251 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:56.350186 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fa8c0-995f-4654-9a8b-9e55432d21de None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:56.461526 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:56.479092 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-866fa8c0-995f-4654-9a8b-9e55432d21de None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:56.532148 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21692d-4f8a-43ff-8d69-e02f54ed0d80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:56.532821 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21692d-4f8a-43ff-8d69-e02f54ed0d80 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:56.533149 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21692d-4f8a-43ff-8d69-e02f54ed0d80 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:56.533441 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce21692d-4f8a-43ff-8d69-e02f54ed0d80 None admin] PATH_INFO: `/v3/users/720ac97c0eb448e6a1ec242e33608160` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:56.534707 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21692d-4f8a-43ff-8d69-e02f54ed0d80 None admin] RBAC: Authorizing `identity:get_user(user_id=720ac97c0eb448e6a1ec242e33608160)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:56.536224 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce21692d-4f8a-43ff-8d69-e02f54ed0d80 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:56.537973 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 543/1082] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:53:56 2022] GET /identity/v3/users/720ac97c0eb448e6a1ec242e33608160 => generated 285 bytes in 189 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:56.544198 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb277731-d910-4209-a1de-d5a786ca9cca None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:56.661852 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb277731-d910-4209-a1de-d5a786ca9cca None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:56.697642 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6c5f5eb-c149-480b-9628-ca1bcf7969b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:56.698397 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5f5eb-c149-480b-9628-ca1bcf7969b8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:56.698564 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5f5eb-c149-480b-9628-ca1bcf7969b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:56.698864 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6c5f5eb-c149-480b-9628-ca1bcf7969b8 None admin] PATH_INFO: `/v3/projects/e8e27d583fc14060b9ba9f9b94a0500d` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:56.700032 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5f5eb-c149-480b-9628-ca1bcf7969b8 None admin] RBAC: Authorizing `identity:get_project(project_id=e8e27d583fc14060b9ba9f9b94a0500d)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:56.701510 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6c5f5eb-c149-480b-9628-ca1bcf7969b8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:56.703381 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 540/1083] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:53:56 2022] GET /identity/v3/projects/e8e27d583fc14060b9ba9f9b94a0500d => generated 311 bytes in 160 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:56.709255 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21692d-4f8a-43ff-8d69-e02f54ed0d80 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:56.812863 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce21692d-4f8a-43ff-8d69-e02f54ed0d80 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:56.849138 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e02c208f-6487-4ec5-b7d2-246b020a2b4e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:56.849976 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c208f-6487-4ec5-b7d2-246b020a2b4e None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:56.850294 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c208f-6487-4ec5-b7d2-246b020a2b4e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:56.850559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e02c208f-6487-4ec5-b7d2-246b020a2b4e None admin] PATH_INFO: `/v3/projects/e8e27d583fc14060b9ba9f9b94a0500d/users/720ac97c0eb448e6a1ec242e33608160/roles/c73e9539582145ed8eedc48648b9d738` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:56.852586 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c208f-6487-4ec5-b7d2-246b020a2b4e None admin] RBAC: Authorizing `identity:create_grant(project_id=e8e27d583fc14060b9ba9f9b94a0500d, user_id=720ac97c0eb448e6a1ec242e33608160, role_id=c73e9539582145ed8eedc48648b9d738)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:56.857739 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e02c208f-6487-4ec5-b7d2-246b020a2b4e None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:56.870049 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 544/1084] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 21 00:53:56 2022] PUT /identity/v3/projects/e8e27d583fc14060b9ba9f9b94a0500d/users/720ac97c0eb448e6a1ec242e33608160/roles/c73e9539582145ed8eedc48648b9d738 => generated 0 bytes in 161 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:53:57.446754 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031f20e-1231-46db-b188-4e64b1b42430 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:57.447031 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031f20e-1231-46db-b188-4e64b1b42430 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:57.447288 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3031f20e-1231-46db-b188-4e64b1b42430 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:57.448750 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 541/1085] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:53:57.455931 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe175c-97ee-4211-8a2c-9b96bd03ed66 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:57.456537 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe175c-97ee-4211-8a2c-9b96bd03ed66 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:57.457135 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07fe175c-97ee-4211-8a2c-9b96bd03ed66 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:57.487276 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-07fe175c-97ee-4211-8a2c-9b96bd03ed66 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:57.489303 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-07fe175c-97ee-4211-8a2c-9b96bd03ed66 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:57.507560 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:57.573639 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 545/1086] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:57 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:53:57.843099 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031f20e-1231-46db-b188-4e64b1b42430 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:57.922224 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:57.972757 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3031f20e-1231-46db-b188-4e64b1b42430 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:58.020778 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0815f-76af-4f22-abd7-51263daffa80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:58.021451 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0815f-76af-4f22-abd7-51263daffa80 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:58.021721 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0815f-76af-4f22-abd7-51263daffa80 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:58.021990 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd0815f-76af-4f22-abd7-51263daffa80 None admin] PATH_INFO: `/v3/roles/ResellerAdmin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:58.045656 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd0815f-76af-4f22-abd7-51263daffa80 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:53:58.051191 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-7bd0815f-76af-4f22-abd7-51263daffa80 None admin] Could not find role: ResellerAdmin.: keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:53:58.051191 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:58.051191 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:58.051191 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:58.051191 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:58.051191 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:58.051191 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:58.051191 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:58.051191 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:58.051191 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:58.051191 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:58.051191 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:58.051191 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:53:58.051191 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:53:58.051191 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:53:58.051191 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:53:58.052406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:53:58.052406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:53:58.052406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:53:58.052406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:53:58.052406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:58.052406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:58.052406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:58.052406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:58.052406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:58.052406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:58.052406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:58.052406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:58.052406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:58.052406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:58.052406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:58.052406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:58.053362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:58.053362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:58.053362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:58.053362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:58.053362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:53:58.053362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:53:58.053362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:53:58.053362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:53:58.053362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:53:58.053362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:53:58.053362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: ResellerAdmin. Aug 21 00:53:58.053362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:58.053362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 542/1087] 10.222.0.49 () {56 vars in 1120 bytes} [Sun Aug 21 00:53:57 2022] GET /identity/v3/roles/ResellerAdmin => generated 91 bytes in 210 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:58.060475 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe175c-97ee-4211-8a2c-9b96bd03ed66 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:58.173216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07fe175c-97ee-4211-8a2c-9b96bd03ed66 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:58.233138 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f0a2b-2951-4f97-b6dd-43d2e67c1daa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:58.234182 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f0a2b-2951-4f97-b6dd-43d2e67c1daa None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:58.234965 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f0a2b-2951-4f97-b6dd-43d2e67c1daa None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:58.235349 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b68f0a2b-2951-4f97-b6dd-43d2e67c1daa None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:58.236226 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f0a2b-2951-4f97-b6dd-43d2e67c1daa None admin] RBAC: Adding query filter params (name=ResellerAdmin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:58.236597 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f0a2b-2951-4f97-b6dd-43d2e67c1daa None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:58.238263 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b68f0a2b-2951-4f97-b6dd-43d2e67c1daa None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:58.248394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 546/1088] 10.222.0.49 () {56 vars in 1115 bytes} [Sun Aug 21 00:53:58 2022] GET /identity/v3/roles?name=ResellerAdmin => generated 338 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:58.255435 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0815f-76af-4f22-abd7-51263daffa80 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:58.403452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd0815f-76af-4f22-abd7-51263daffa80 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:58.435308 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:58.448835 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b86c7-fb69-4eef-b091-b8bfe6831b79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:58.449678 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b86c7-fb69-4eef-b091-b8bfe6831b79 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:58.449963 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b86c7-fb69-4eef-b091-b8bfe6831b79 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:58.450237 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb6b86c7-fb69-4eef-b091-b8bfe6831b79 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:58.463534 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b86c7-fb69-4eef-b091-b8bfe6831b79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:58.465291 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eb6b86c7-fb69-4eef-b091-b8bfe6831b79 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:58.482194 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-eb6b86c7-fb69-4eef-b091-b8bfe6831b79 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:58.482194 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:58.482194 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:58.482194 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:58.482194 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:58.482194 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:58.482194 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:58.482194 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:58.482194 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:58.482194 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:58.482194 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:58.482194 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:58.482194 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:58.482194 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:58.482194 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:58.482194 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:58.483334 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:58.483334 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:58.483334 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:58.483334 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:58.483334 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:58.483334 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:58.483334 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:58.483334 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:58.483334 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:58.483334 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:58.483334 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:58.483334 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:58.483334 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:58.483334 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:58.483334 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:58.483334 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:58.483334 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:58.484863 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:58.484863 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:58.484863 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:58.484863 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 543/1089] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:58 2022] GET /identity/v3/domains/Default => generated 87 bytes in 229 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:58.490431 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f0a2b-2951-4f97-b6dd-43d2e67c1daa None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:58.505336 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:58.611352 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b68f0a2b-2951-4f97-b6dd-43d2e67c1daa None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:58.649027 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4bf055af-acef-4a2d-b2b3-818c4834837c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:58.649702 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf055af-acef-4a2d-b2b3-818c4834837c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:58.649977 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf055af-acef-4a2d-b2b3-818c4834837c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:58.650251 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4bf055af-acef-4a2d-b2b3-818c4834837c None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:58.650914 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf055af-acef-4a2d-b2b3-818c4834837c None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:58.651217 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf055af-acef-4a2d-b2b3-818c4834837c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:58.652731 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4bf055af-acef-4a2d-b2b3-818c4834837c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:58.667073 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 547/1090] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:58 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:53:58.673007 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b86c7-fb69-4eef-b091-b8bfe6831b79 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:58.789158 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb6b86c7-fb69-4eef-b091-b8bfe6831b79 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:58.843442 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e31c72-e1f7-420c-b141-b6b363c8351e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:58.844336 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e31c72-e1f7-420c-b141-b6b363c8351e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:58.844502 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e31c72-e1f7-420c-b141-b6b363c8351e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:58.844722 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d0e31c72-e1f7-420c-b141-b6b363c8351e None admin] PATH_INFO: `/v3/users/nova` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:58.854619 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e31c72-e1f7-420c-b141-b6b363c8351e None admin] RBAC: Authorizing `identity:get_user(user_id=nova)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:58.856066 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d0e31c72-e1f7-420c-b141-b6b363c8351e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:58.858065 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236f8af-46c2-4c33-922e-c5fbc8a37571 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:58.858354 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236f8af-46c2-4c33-922e-c5fbc8a37571 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:58.858631 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6236f8af-46c2-4c33-922e-c5fbc8a37571 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:58.860010 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 548/1091] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:53:58 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:53:58.865825 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4464f-b8d6-4b9a-8b73-e3d3a055205c None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:58.866086 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4464f-b8d6-4b9a-8b73-e3d3a055205c None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:58.866362 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79d4464f-b8d6-4b9a-8b73-e3d3a055205c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:58.869843 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-d0e31c72-e1f7-420c-b141-b6b363c8351e None admin] Could not find user: nova.: keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:53:58.869843 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:58.869843 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:58.869843 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:58.869843 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:58.869843 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:58.869843 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:58.869843 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:58.869843 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:58.869843 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:58.869843 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:58.869843 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:58.869843 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:53:58.869843 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:53:58.869843 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:53:58.869843 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:53:58.871597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:58.871597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:58.871597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:53:58.871597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:58.871597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:53:58.871597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:53:58.871597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:58.871597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:58.871597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:58.871597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:58.871597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:58.871597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:58.871597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:58.871597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:58.871597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:58.871597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:58.871597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:58.871597 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:58.873674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:58.873674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:58.873674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:53:58.873674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:53:58.873674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:53:58.873674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:53:58.873674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:53:58.873674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:53:58.873674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: nova. Aug 21 00:53:58.873674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:58.876391 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 544/1092] 10.222.0.49 () {56 vars in 1093 bytes} [Sun Aug 21 00:53:58 2022] GET /identity/v3/users/nova => generated 82 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:58.877344 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e31c72-e1f7-420c-b141-b6b363c8351e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:58.891093 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-79d4464f-b8d6-4b9a-8b73-e3d3a055205c None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:53:58.892332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-79d4464f-b8d6-4b9a-8b73-e3d3a055205c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:53:58.918645 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:58.963277 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:58.970700 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 549/1093] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:53:58 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:53:58.997425 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d0e31c72-e1f7-420c-b141-b6b363c8351e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:59.040350 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cb83e-23f3-42e0-8763-1e046cfb9bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:59.040926 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cb83e-23f3-42e0-8763-1e046cfb9bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:59.041450 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cb83e-23f3-42e0-8763-1e046cfb9bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:59.042005 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-732cb83e-23f3-42e0-8763-1e046cfb9bb1 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:59.043352 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732cb83e-23f3-42e0-8763-1e046cfb9bb1 None admin] RBAC: Adding query filter params (domain_id=default, name=nova) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:59.043900 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732cb83e-23f3-42e0-8763-1e046cfb9bb1 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:59.046557 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-732cb83e-23f3-42e0-8763-1e046cfb9bb1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:59.078131 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 545/1094] 10.222.0.49 () {56 vars in 1133 bytes} [Sun Aug 21 00:53:58 2022] GET /identity/v3/users?domain_id=default&name=nova => generated 368 bytes in 201 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:59.085363 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4464f-b8d6-4b9a-8b73-e3d3a055205c None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:59.205916 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79d4464f-b8d6-4b9a-8b73-e3d3a055205c None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:59.242562 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cb83e-23f3-42e0-8763-1e046cfb9bb1 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:59.261620 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b62e22-09c4-44cd-abf7-a8db2852931a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:59.262688 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b62e22-09c4-44cd-abf7-a8db2852931a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:59.263166 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b62e22-09c4-44cd-abf7-a8db2852931a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:59.263652 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b62e22-09c4-44cd-abf7-a8db2852931a None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:59.345660 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:59.353958 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-732cb83e-23f3-42e0-8763-1e046cfb9bb1 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:59.359724 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:59.365304 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b62e22-09c4-44cd-abf7-a8db2852931a None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:59.368038 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b62e22-09c4-44cd-abf7-a8db2852931a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:59.398765 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aecbee-d115-4ff8-a6ef-63dbec82663a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:59.399827 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aecbee-d115-4ff8-a6ef-63dbec82663a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:59.400323 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aecbee-d115-4ff8-a6ef-63dbec82663a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:59.400770 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17aecbee-d115-4ff8-a6ef-63dbec82663a None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:59.418381 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17aecbee-d115-4ff8-a6ef-63dbec82663a None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:53:59.428126 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-17aecbee-d115-4ff8-a6ef-63dbec82663a None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:53:59.428126 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:59.428126 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:59.428126 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:59.428126 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:59.428126 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:59.428126 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:59.428126 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:59.428126 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:59.428126 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:59.428126 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:59.428126 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:59.428126 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:53:59.428126 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:53:59.428126 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:53:59.428126 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:53:59.429171 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:53:59.429171 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:53:59.429171 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:53:59.429171 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:53:59.429171 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:59.429171 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:59.429171 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:59.429171 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:59.429171 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:59.429171 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:59.429171 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:59.429171 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:59.429171 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:59.429171 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:59.429171 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:59.429171 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:59.430089 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:59.430089 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:59.430089 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:59.430089 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:59.430089 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:53:59.430089 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:53:59.430089 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:53:59.430089 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:53:59.430089 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:53:59.430089 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:53:59.430089 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:53:59.430089 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:53:59.430731 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 546/1095] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:53:59 2022] GET /identity/v3/roles/admin => generated 83 bytes in 188 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:53:59.437680 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aecbee-d115-4ff8-a6ef-63dbec82663a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:59.493574 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 550/1096] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:53:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 401 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:53:59.494762 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b62e22-09c4-44cd-abf7-a8db2852931a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:59.565888 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17aecbee-d115-4ff8-a6ef-63dbec82663a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:59.605252 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:59.609766 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b62e22-09c4-44cd-abf7-a8db2852931a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:59.615458 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcef19-8269-4f24-a4e4-4e6598ada602 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:59.616086 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcef19-8269-4f24-a4e4-4e6598ada602 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:59.616366 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcef19-8269-4f24-a4e4-4e6598ada602 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:59.616639 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1abcef19-8269-4f24-a4e4-4e6598ada602 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:59.617365 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abcef19-8269-4f24-a4e4-4e6598ada602 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:59.617675 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abcef19-8269-4f24-a4e4-4e6598ada602 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:59.619091 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1abcef19-8269-4f24-a4e4-4e6598ada602 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:59.636444 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 547/1097] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:53:59 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:59.637748 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcef19-8269-4f24-a4e4-4e6598ada602 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:59.651999 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c77522-7208-4b0a-9da9-1bbbe83cb5e7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:59.652643 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c77522-7208-4b0a-9da9-1bbbe83cb5e7 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:59.652917 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c77522-7208-4b0a-9da9-1bbbe83cb5e7 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:59.653236 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-16c77522-7208-4b0a-9da9-1bbbe83cb5e7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:59.657412 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:59.666325 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c77522-7208-4b0a-9da9-1bbbe83cb5e7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:59.667902 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-16c77522-7208-4b0a-9da9-1bbbe83cb5e7 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:59.694566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-16c77522-7208-4b0a-9da9-1bbbe83cb5e7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:59.694566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:53:59.694566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:53:59.694566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:53:59.694566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:53:59.694566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:53:59.694566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:53:59.694566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:53:59.694566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:53:59.694566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:53:59.694566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:53:59.694566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:53:59.694566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:53:59.694566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:53:59.694566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:53:59.694566 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:53:59.695784 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:53:59.695784 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:53:59.695784 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:53:59.695784 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:53:59.695784 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:53:59.695784 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:53:59.695784 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:53:59.695784 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:53:59.695784 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:53:59.695784 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:53:59.695784 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:53:59.695784 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:53:59.695784 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:53:59.695784 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:53:59.695784 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:53:59.695784 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:53:59.695784 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:53:59.696779 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:53:59.696779 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:53:59.696779 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:53:59.696779 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 551/1098] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:53:59 2022] GET /identity/v3/domains/Default => generated 87 bytes in 202 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:53:59.703078 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c77522-7208-4b0a-9da9-1bbbe83cb5e7 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:59.757089 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1abcef19-8269-4f24-a4e4-4e6598ada602 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:59.806778 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599273dc-562f-45b1-960c-99b2c7cfe00f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:59.807806 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599273dc-562f-45b1-960c-99b2c7cfe00f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:59.808240 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599273dc-562f-45b1-960c-99b2c7cfe00f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:59.808676 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-599273dc-562f-45b1-960c-99b2c7cfe00f None admin] PATH_INFO: `/v3/users/720ac97c0eb448e6a1ec242e33608160` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:59.810418 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599273dc-562f-45b1-960c-99b2c7cfe00f None admin] RBAC: Authorizing `identity:get_user(user_id=720ac97c0eb448e6a1ec242e33608160)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:59.812766 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-599273dc-562f-45b1-960c-99b2c7cfe00f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:59.820345 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 548/1099] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:53:59 2022] GET /identity/v3/users/720ac97c0eb448e6a1ec242e33608160 => generated 285 bytes in 178 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:59.821621 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599273dc-562f-45b1-960c-99b2c7cfe00f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:59.839910 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-16c77522-7208-4b0a-9da9-1bbbe83cb5e7 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:53:59.882893 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f117d2-f3c4-4723-b1b9-c112eec5ceb4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:53:59.883395 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f117d2-f3c4-4723-b1b9-c112eec5ceb4 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:53:59.883672 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f117d2-f3c4-4723-b1b9-c112eec5ceb4 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:53:59.883940 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-49f117d2-f3c4-4723-b1b9-c112eec5ceb4 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:53:59.884588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f117d2-f3c4-4723-b1b9-c112eec5ceb4 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:53:59.884887 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f117d2-f3c4-4723-b1b9-c112eec5ceb4 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:53:59.886721 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-49f117d2-f3c4-4723-b1b9-c112eec5ceb4 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:53:59.900581 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 552/1100] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:53:59 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 198 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:53:59.906332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f117d2-f3c4-4723-b1b9-c112eec5ceb4 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:53:59.918769 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:59.949723 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:53:59.968260 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-599273dc-562f-45b1-960c-99b2c7cfe00f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:00.009973 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aecf64-1c95-44ea-a416-d27d7370bcec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:00.010593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aecf64-1c95-44ea-a416-d27d7370bcec None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:00.010894 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aecf64-1c95-44ea-a416-d27d7370bcec None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:00.011163 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31aecf64-1c95-44ea-a416-d27d7370bcec None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:00.030410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-49f117d2-f3c4-4723-b1b9-c112eec5ceb4 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:00.076016 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6174521-3026-4dbe-8d40-6b4858afef87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:00.076674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6174521-3026-4dbe-8d40-6b4858afef87 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:00.077032 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6174521-3026-4dbe-8d40-6b4858afef87 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:00.077461 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6174521-3026-4dbe-8d40-6b4858afef87 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:00.085833 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6174521-3026-4dbe-8d40-6b4858afef87 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:00.086822 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6174521-3026-4dbe-8d40-6b4858afef87 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:00.098767 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-a6174521-3026-4dbe-8d40-6b4858afef87 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:54:00.098767 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:54:00.098767 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:54:00.098767 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:54:00.098767 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:54:00.098767 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:54:00.098767 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:54:00.098767 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:54:00.098767 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:54:00.098767 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:54:00.098767 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:54:00.098767 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:54:00.098767 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:54:00.098767 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:54:00.098767 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:54:00.100177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:54:00.100177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:54:00.100177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:54:00.100177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:54:00.100177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:54:00.100177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:54:00.100177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:54:00.100177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:54:00.100177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:54:00.100177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:54:00.100177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:54:00.100177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:54:00.100177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:54:00.100177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:54:00.100177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:54:00.100177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:54:00.100177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:54:00.101261 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:54:00.101261 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:54:00.101261 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:54:00.101261 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:54:00.101261 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:54:00.101261 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:54:00.101261 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:54:00.101261 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:54:00.101261 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 553/1101] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:53:59 2022] GET /identity/v3/projects/service => generated 88 bytes in 194 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:54:00.101807 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aecf64-1c95-44ea-a416-d27d7370bcec None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:00.103243 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31aecf64-1c95-44ea-a416-d27d7370bcec None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:00.108221 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6174521-3026-4dbe-8d40-6b4858afef87 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:00.188583 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:00.201922 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:00.224266 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 549/1102] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:53:59 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 403 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:54:00.229707 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6174521-3026-4dbe-8d40-6b4858afef87 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:00.230731 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aecf64-1c95-44ea-a416-d27d7370bcec None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:00.276302 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4dc21-f89c-46d2-a8a2-6a7d622a1f87 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:00.277396 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4dc21-f89c-46d2-a8a2-6a7d622a1f87 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:00.277886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4dc21-f89c-46d2-a8a2-6a7d622a1f87 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:00.278365 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80a4dc21-f89c-46d2-a8a2-6a7d622a1f87 None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:00.279652 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4dc21-f89c-46d2-a8a2-6a7d622a1f87 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:54:00.280022 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4dc21-f89c-46d2-a8a2-6a7d622a1f87 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:00.282866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80a4dc21-f89c-46d2-a8a2-6a7d622a1f87 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:00.300298 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 554/1103] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:54:00 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:54:00.309421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4dc21-f89c-46d2-a8a2-6a7d622a1f87 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:00.351176 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31aecf64-1c95-44ea-a416-d27d7370bcec None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:00.398825 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807b4be-0a94-4aea-b38b-0d7c0b9dca79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:00.399557 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807b4be-0a94-4aea-b38b-0d7c0b9dca79 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:00.399874 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807b4be-0a94-4aea-b38b-0d7c0b9dca79 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:00.400162 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6807b4be-0a94-4aea-b38b-0d7c0b9dca79 None admin] PATH_INFO: `/v3/projects/e8e27d583fc14060b9ba9f9b94a0500d` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:00.401652 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807b4be-0a94-4aea-b38b-0d7c0b9dca79 None admin] RBAC: Authorizing `identity:get_project(project_id=e8e27d583fc14060b9ba9f9b94a0500d)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:00.403388 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6807b4be-0a94-4aea-b38b-0d7c0b9dca79 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:00.405247 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 550/1104] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:54:00 2022] GET /identity/v3/projects/e8e27d583fc14060b9ba9f9b94a0500d => generated 311 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:54:00.411635 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807b4be-0a94-4aea-b38b-0d7c0b9dca79 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:00.453401 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80a4dc21-f89c-46d2-a8a2-6a7d622a1f87 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:00.473846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:00.487088 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:00.494710 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-828338ec-63ab-4a24-b966-d8072877fef8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:00.495725 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828338ec-63ab-4a24-b966-d8072877fef8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:00.495725 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828338ec-63ab-4a24-b966-d8072877fef8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:00.495946 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-828338ec-63ab-4a24-b966-d8072877fef8 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:00.496613 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828338ec-63ab-4a24-b966-d8072877fef8 None admin] RBAC: Adding query filter params (role.id=bfc1c16a629c46a0883a2f7363d940cf, scope.project.id=838e996d09a0454b9bcdc5aef03ef203, user.id=6b003ae4a082485ab608bf84c1657159) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:54:00.496920 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828338ec-63ab-4a24-b966-d8072877fef8 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:00.498422 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-828338ec-63ab-4a24-b966-d8072877fef8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:00.505674 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 555/1105] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:54:00 2022] GET /identity/v3/role_assignments?user.id=6b003ae4a082485ab608bf84c1657159&scope.project.id=838e996d09a0454b9bcdc5aef03ef203&role.id=bfc1c16a629c46a0883a2f7363d940cf => generated 608 bytes in 197 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:54:00.542347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6807b4be-0a94-4aea-b38b-0d7c0b9dca79 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:00.582682 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2736f713-51dc-4edf-a28d-edf68bf7690d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:00.583316 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736f713-51dc-4edf-a28d-edf68bf7690d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:00.583592 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736f713-51dc-4edf-a28d-edf68bf7690d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:00.583846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2736f713-51dc-4edf-a28d-edf68bf7690d None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:00.584622 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736f713-51dc-4edf-a28d-edf68bf7690d None admin] RBAC: Adding query filter params (role.id=c73e9539582145ed8eedc48648b9d738, scope.project.id=e8e27d583fc14060b9ba9f9b94a0500d, user.id=720ac97c0eb448e6a1ec242e33608160) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:54:00.584916 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736f713-51dc-4edf-a28d-edf68bf7690d None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:00.586475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2736f713-51dc-4edf-a28d-edf68bf7690d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:00.593576 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 551/1106] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:54:00 2022] GET /identity/v3/role_assignments?user.id=720ac97c0eb448e6a1ec242e33608160&scope.project.id=e8e27d583fc14060b9ba9f9b94a0500d&role.id=c73e9539582145ed8eedc48648b9d738 => generated 608 bytes in 182 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:54:02.607338 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c77eca-679b-427c-97d4-33dd62705a84 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:02.607905 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c77eca-679b-427c-97d4-33dd62705a84 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:02.607905 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7c77eca-679b-427c-97d4-33dd62705a84 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:02.609167 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 556/1107] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:54:02 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:54:02.614527 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0a194-a7f8-4c14-a7ec-cd14bcb0b42e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:02.614995 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0a194-a7f8-4c14-a7ec-cd14bcb0b42e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:02.615095 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-57c0a194-a7f8-4c14-a7ec-cd14bcb0b42e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:02.633769 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-57c0a194-a7f8-4c14-a7ec-cd14bcb0b42e None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:54:02.634949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-57c0a194-a7f8-4c14-a7ec-cd14bcb0b42e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:54:02.705680 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 552/1108] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:54:02 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:54:02.980747 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c77eca-679b-427c-97d4-33dd62705a84 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:03.089828 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7c77eca-679b-427c-97d4-33dd62705a84 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:03.126604 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c57a8609-5eaa-4393-bb58-aa95bf0b4a79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:03.127240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a8609-5eaa-4393-bb58-aa95bf0b4a79 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:03.127516 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a8609-5eaa-4393-bb58-aa95bf0b4a79 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:03.127782 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c57a8609-5eaa-4393-bb58-aa95bf0b4a79 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:03.128945 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a8609-5eaa-4393-bb58-aa95bf0b4a79 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:03.130431 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c57a8609-5eaa-4393-bb58-aa95bf0b4a79 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:03.132053 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 557/1109] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:54:02 2022] GET /identity/v3/domains/default => generated 199 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:03.138053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0a194-a7f8-4c14-a7ec-cd14bcb0b42e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:03.183516 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:03.238115 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-57c0a194-a7f8-4c14-a7ec-cd14bcb0b42e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:03.274053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b3beff5-d008-4378-96d1-dc2f7952032d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:03.274663 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3beff5-d008-4378-96d1-dc2f7952032d None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:03.274937 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3beff5-d008-4378-96d1-dc2f7952032d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:03.275204 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b3beff5-d008-4378-96d1-dc2f7952032d None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:03.275844 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3beff5-d008-4378-96d1-dc2f7952032d None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:03.277338 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b3beff5-d008-4378-96d1-dc2f7952032d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:03.299366 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 553/1110] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 21 00:54:03 2022] POST /identity/v3/users => generated 286 bytes in 162 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:54:05.268349 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b103a-8745-46c2-a6c0-91082f2d3616 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:05.268927 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b103a-8745-46c2-a6c0-91082f2d3616 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:05.268927 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-704b103a-8745-46c2-a6c0-91082f2d3616 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:05.270290 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 558/1111] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:54:05 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:54:05.275861 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cc86e-85f2-4d25-84d1-12a3f45ccf6a None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:05.276389 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cc86e-85f2-4d25-84d1-12a3f45ccf6a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:05.276492 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8d9cc86e-85f2-4d25-84d1-12a3f45ccf6a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:05.295797 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-8d9cc86e-85f2-4d25-84d1-12a3f45ccf6a None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:54:05.297012 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8d9cc86e-85f2-4d25-84d1-12a3f45ccf6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:54:05.366379 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 554/1112] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:54:05 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 91 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:54:05.633588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b103a-8745-46c2-a6c0-91082f2d3616 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:05.701701 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:05.742995 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-704b103a-8745-46c2-a6c0-91082f2d3616 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:05.781620 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9798da-33df-4649-9c6c-c022307791aa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:05.782390 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9798da-33df-4649-9c6c-c022307791aa None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:05.782696 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9798da-33df-4649-9c6c-c022307791aa None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:05.783021 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b9798da-33df-4649-9c6c-c022307791aa None admin] PATH_INFO: `/v3/roles/f186b24dc4eb43668f180c85b7c1fc20` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:05.784660 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9798da-33df-4649-9c6c-c022307791aa None admin] RBAC: Authorizing `identity:get_role(role_id=f186b24dc4eb43668f180c85b7c1fc20)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:05.786186 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b9798da-33df-4649-9c6c-c022307791aa None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:05.787936 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 559/1113] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:54:05 2022] GET /identity/v3/roles/f186b24dc4eb43668f180c85b7c1fc20 => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:05.794090 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cc86e-85f2-4d25-84d1-12a3f45ccf6a None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:05.825332 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:05.898318 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8d9cc86e-85f2-4d25-84d1-12a3f45ccf6a None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:05.932500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a251e6-1944-4488-b5b2-58d116a553c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:05.933190 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a251e6-1944-4488-b5b2-58d116a553c4 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:05.933458 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a251e6-1944-4488-b5b2-58d116a553c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:05.933723 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74a251e6-1944-4488-b5b2-58d116a553c4 None admin] PATH_INFO: `/v3/users/96c2c75838d94a57943d7400740aeb55` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:05.947906 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a251e6-1944-4488-b5b2-58d116a553c4 None admin] RBAC: Authorizing `identity:get_user(user_id=96c2c75838d94a57943d7400740aeb55)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:05.949423 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74a251e6-1944-4488-b5b2-58d116a553c4 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:05.951120 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 555/1114] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:54:05 2022] GET /identity/v3/users/96c2c75838d94a57943d7400740aeb55 => generated 286 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:54:05.957211 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9798da-33df-4649-9c6c-c022307791aa None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:06.062925 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b9798da-33df-4649-9c6c-c022307791aa None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:06.095159 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:06.101806 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bb053-96dc-4b01-a57a-0b4a245efdd0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:06.102421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bb053-96dc-4b01-a57a-0b4a245efdd0 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:06.102697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bb053-96dc-4b01-a57a-0b4a245efdd0 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:06.102958 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6b8bb053-96dc-4b01-a57a-0b4a245efdd0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:06.172675 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8bb053-96dc-4b01-a57a-0b4a245efdd0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:06.174066 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6b8bb053-96dc-4b01-a57a-0b4a245efdd0 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:06.280513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 560/1115] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:54:05 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 324 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:54:06.286808 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a251e6-1944-4488-b5b2-58d116a553c4 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:06.382784 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:06.392742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74a251e6-1944-4488-b5b2-58d116a553c4 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:06.427107 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-697fd78a-a379-4274-a2bd-77bee0aca7f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:06.427650 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fd78a-a379-4274-a2bd-77bee0aca7f0 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:06.427927 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fd78a-a379-4274-a2bd-77bee0aca7f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:06.428197 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-697fd78a-a379-4274-a2bd-77bee0aca7f0 None admin] PATH_INFO: `/v3/projects/e8e27d583fc14060b9ba9f9b94a0500d` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:06.429358 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fd78a-a379-4274-a2bd-77bee0aca7f0 None admin] RBAC: Authorizing `identity:get_project(project_id=e8e27d583fc14060b9ba9f9b94a0500d)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:06.430783 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-697fd78a-a379-4274-a2bd-77bee0aca7f0 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:06.432437 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 556/1116] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:54:06 2022] GET /identity/v3/projects/e8e27d583fc14060b9ba9f9b94a0500d => generated 311 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:06.438875 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bb053-96dc-4b01-a57a-0b4a245efdd0 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:06.470391 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:06.543054 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6b8bb053-96dc-4b01-a57a-0b4a245efdd0 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:06.577939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e4903ccb-d602-44aa-96b5-e8f86ac37b39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:06.578548 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4903ccb-d602-44aa-96b5-e8f86ac37b39 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:06.578823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4903ccb-d602-44aa-96b5-e8f86ac37b39 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:06.579093 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e4903ccb-d602-44aa-96b5-e8f86ac37b39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:06.579815 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4903ccb-d602-44aa-96b5-e8f86ac37b39 None admin] RBAC: Adding query filter params (role.id=f186b24dc4eb43668f180c85b7c1fc20, scope.project.id=e8e27d583fc14060b9ba9f9b94a0500d, user.id=96c2c75838d94a57943d7400740aeb55) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:54:06.580117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4903ccb-d602-44aa-96b5-e8f86ac37b39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:06.581588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e4903ccb-d602-44aa-96b5-e8f86ac37b39 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:06.587304 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 561/1117] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:54:06 2022] GET /identity/v3/role_assignments?user.id=96c2c75838d94a57943d7400740aeb55&scope.project.id=e8e27d583fc14060b9ba9f9b94a0500d&role.id=f186b24dc4eb43668f180c85b7c1fc20 => generated 259 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:08.483878 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b89c9b-dc9e-410c-8f13-e9c53da76eb4 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:08.484421 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b89c9b-dc9e-410c-8f13-e9c53da76eb4 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:08.484421 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75b89c9b-dc9e-410c-8f13-e9c53da76eb4 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:08.485695 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 557/1118] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:54:08 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:54:08.491793 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8181e18-2dd8-4c7d-abfb-998dccd15c89 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:08.492308 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8181e18-2dd8-4c7d-abfb-998dccd15c89 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:08.492308 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8181e18-2dd8-4c7d-abfb-998dccd15c89 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:08.511791 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-f8181e18-2dd8-4c7d-abfb-998dccd15c89 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:54:08.513035 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-f8181e18-2dd8-4c7d-abfb-998dccd15c89 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:54:08.586992 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 562/1119] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:54:08 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:54:08.850875 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b89c9b-dc9e-410c-8f13-e9c53da76eb4 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:08.962824 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-75b89c9b-dc9e-410c-8f13-e9c53da76eb4 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:08.999923 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4e7e6-33b5-4800-b7fa-af24f6fad301 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:09.000871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4e7e6-33b5-4800-b7fa-af24f6fad301 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:09.001170 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4e7e6-33b5-4800-b7fa-af24f6fad301 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:09.001440 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80d4e7e6-33b5-4800-b7fa-af24f6fad301 None admin] PATH_INFO: `/v3/roles/f186b24dc4eb43668f180c85b7c1fc20` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:09.002889 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4e7e6-33b5-4800-b7fa-af24f6fad301 None admin] RBAC: Authorizing `identity:get_role(role_id=f186b24dc4eb43668f180c85b7c1fc20)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:09.004257 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80d4e7e6-33b5-4800-b7fa-af24f6fad301 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:09.005650 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 558/1120] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:54:08 2022] GET /identity/v3/roles/f186b24dc4eb43668f180c85b7c1fc20 => generated 223 bytes in 155 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:09.012824 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8181e18-2dd8-4c7d-abfb-998dccd15c89 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:09.044452 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:09.132990 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8181e18-2dd8-4c7d-abfb-998dccd15c89 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:09.173887 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3705de-ab6c-4089-927c-3d517c5b8e2a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:09.174557 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3705de-ab6c-4089-927c-3d517c5b8e2a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:09.174830 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3705de-ab6c-4089-927c-3d517c5b8e2a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:09.175102 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7b3705de-ab6c-4089-927c-3d517c5b8e2a None admin] PATH_INFO: `/v3/users/96c2c75838d94a57943d7400740aeb55` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:09.176375 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3705de-ab6c-4089-927c-3d517c5b8e2a None admin] RBAC: Authorizing `identity:get_user(user_id=96c2c75838d94a57943d7400740aeb55)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:09.177889 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7b3705de-ab6c-4089-927c-3d517c5b8e2a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:09.179595 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 563/1121] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:54:09 2022] GET /identity/v3/users/96c2c75838d94a57943d7400740aeb55 => generated 286 bytes in 167 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:54:09.185848 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4e7e6-33b5-4800-b7fa-af24f6fad301 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:09.218114 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:09.314010 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80d4e7e6-33b5-4800-b7fa-af24f6fad301 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:09.374795 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f30cd231-9fff-4319-ac80-e64b08a4fea1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:09.376170 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cd231-9fff-4319-ac80-e64b08a4fea1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:09.376636 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cd231-9fff-4319-ac80-e64b08a4fea1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:09.377217 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f30cd231-9fff-4319-ac80-e64b08a4fea1 None admin] PATH_INFO: `/v3/projects/e8e27d583fc14060b9ba9f9b94a0500d` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:09.379114 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30cd231-9fff-4319-ac80-e64b08a4fea1 None admin] RBAC: Authorizing `identity:get_project(project_id=e8e27d583fc14060b9ba9f9b94a0500d)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:09.381916 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f30cd231-9fff-4319-ac80-e64b08a4fea1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:09.384965 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 559/1122] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:54:09 2022] GET /identity/v3/projects/e8e27d583fc14060b9ba9f9b94a0500d => generated 311 bytes in 200 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:09.394839 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3705de-ab6c-4089-927c-3d517c5b8e2a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:09.509926 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:09.521114 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7b3705de-ab6c-4089-927c-3d517c5b8e2a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:09.561946 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2edaee28-a65c-4d60-b826-120ca20a1944 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:09.562807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edaee28-a65c-4d60-b826-120ca20a1944 None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:09.563174 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edaee28-a65c-4d60-b826-120ca20a1944 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:09.563535 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2edaee28-a65c-4d60-b826-120ca20a1944 None admin] PATH_INFO: `/v3/projects/e8e27d583fc14060b9ba9f9b94a0500d/users/96c2c75838d94a57943d7400740aeb55/roles/f186b24dc4eb43668f180c85b7c1fc20` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:09.566130 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edaee28-a65c-4d60-b826-120ca20a1944 None admin] RBAC: Authorizing `identity:create_grant(project_id=e8e27d583fc14060b9ba9f9b94a0500d, user_id=96c2c75838d94a57943d7400740aeb55, role_id=f186b24dc4eb43668f180c85b7c1fc20)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:09.567614 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2edaee28-a65c-4d60-b826-120ca20a1944 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:09.584096 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 564/1123] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 21 00:54:09 2022] PUT /identity/v3/projects/e8e27d583fc14060b9ba9f9b94a0500d/users/96c2c75838d94a57943d7400740aeb55/roles/f186b24dc4eb43668f180c85b7c1fc20 => generated 0 bytes in 190 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:54:12.607379 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e3a1f-12b0-4461-831c-f495b690f4a3 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:12.607978 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e3a1f-12b0-4461-831c-f495b690f4a3 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:12.608232 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b4e3a1f-12b0-4461-831c-f495b690f4a3 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:12.610785 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 560/1124] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:54:12 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:54:12.620009 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81580c81-676a-48b2-8508-5a0f345dd281 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:12.620893 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81580c81-676a-48b2-8508-5a0f345dd281 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:12.620893 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81580c81-676a-48b2-8508-5a0f345dd281 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:12.641756 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-81580c81-676a-48b2-8508-5a0f345dd281 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:54:12.643121 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-81580c81-676a-48b2-8508-5a0f345dd281 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:54:12.724944 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 565/1125] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:54:12 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 106 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:54:12.998039 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e3a1f-12b0-4461-831c-f495b690f4a3 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:13.106534 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:13.119307 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b4e3a1f-12b0-4461-831c-f495b690f4a3 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:13.178802 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0371835-5021-4137-a385-f5f0a58a7475 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:13.180134 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0371835-5021-4137-a385-f5f0a58a7475 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:13.180610 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0371835-5021-4137-a385-f5f0a58a7475 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:13.181107 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0371835-5021-4137-a385-f5f0a58a7475 None admin] PATH_INFO: `/v3/roles/f186b24dc4eb43668f180c85b7c1fc20` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:13.184066 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0371835-5021-4137-a385-f5f0a58a7475 None admin] RBAC: Authorizing `identity:get_role(role_id=f186b24dc4eb43668f180c85b7c1fc20)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:13.186646 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e0371835-5021-4137-a385-f5f0a58a7475 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:13.189166 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 561/1126] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:54:12 2022] GET /identity/v3/roles/f186b24dc4eb43668f180c85b7c1fc20 => generated 223 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:54:13.195767 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81580c81-676a-48b2-8508-5a0f345dd281 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:13.289604 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:13.314007 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-81580c81-676a-48b2-8508-5a0f345dd281 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:13.359161 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567338ad-b45d-4344-bb5b-61a3c557d005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:13.360220 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567338ad-b45d-4344-bb5b-61a3c557d005 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:13.360702 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567338ad-b45d-4344-bb5b-61a3c557d005 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:13.361231 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-567338ad-b45d-4344-bb5b-61a3c557d005 None admin] PATH_INFO: `/v3/users/96c2c75838d94a57943d7400740aeb55` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:13.363196 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567338ad-b45d-4344-bb5b-61a3c557d005 None admin] RBAC: Authorizing `identity:get_user(user_id=96c2c75838d94a57943d7400740aeb55)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:13.365826 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-567338ad-b45d-4344-bb5b-61a3c557d005 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:13.368832 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 566/1127] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:54:13 2022] GET /identity/v3/users/96c2c75838d94a57943d7400740aeb55 => generated 286 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:13.376246 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0371835-5021-4137-a385-f5f0a58a7475 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:13.523116 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0371835-5021-4137-a385-f5f0a58a7475 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:13.582380 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e0a81-484c-432a-a27b-00ecf1099f0f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:13.583350 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e0a81-484c-432a-a27b-00ecf1099f0f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:13.583823 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e0a81-484c-432a-a27b-00ecf1099f0f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:13.584282 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ae0e0a81-484c-432a-a27b-00ecf1099f0f None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:13.640004 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:13.695969 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e0a81-484c-432a-a27b-00ecf1099f0f None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:13.697698 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ae0e0a81-484c-432a-a27b-00ecf1099f0f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:13.819661 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 562/1128] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:54:13 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 445 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:54:13.829146 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567338ad-b45d-4344-bb5b-61a3c557d005 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:13.947776 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-567338ad-b45d-4344-bb5b-61a3c557d005 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:13.986801 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bf1d9544-b525-4a2d-93e6-48f1c4af75c8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:13.987448 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d9544-b525-4a2d-93e6-48f1c4af75c8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:13.987728 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d9544-b525-4a2d-93e6-48f1c4af75c8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:13.988004 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bf1d9544-b525-4a2d-93e6-48f1c4af75c8 None admin] PATH_INFO: `/v3/projects/e8e27d583fc14060b9ba9f9b94a0500d` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:13.989186 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d9544-b525-4a2d-93e6-48f1c4af75c8 None admin] RBAC: Authorizing `identity:get_project(project_id=e8e27d583fc14060b9ba9f9b94a0500d)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:13.990651 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bf1d9544-b525-4a2d-93e6-48f1c4af75c8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:13.992341 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 567/1129] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:54:13 2022] GET /identity/v3/projects/e8e27d583fc14060b9ba9f9b94a0500d => generated 311 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:13.999029 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e0a81-484c-432a-a27b-00ecf1099f0f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:14.066901 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:14.119738 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ae0e0a81-484c-432a-a27b-00ecf1099f0f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:14.183441 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-58fdaa5b-8af6-45f8-932b-0b5b1b949f06 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:14.184465 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdaa5b-8af6-45f8-932b-0b5b1b949f06 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:14.184958 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdaa5b-8af6-45f8-932b-0b5b1b949f06 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:14.185450 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-58fdaa5b-8af6-45f8-932b-0b5b1b949f06 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:14.186710 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdaa5b-8af6-45f8-932b-0b5b1b949f06 None admin] RBAC: Adding query filter params (role.id=f186b24dc4eb43668f180c85b7c1fc20, scope.project.id=e8e27d583fc14060b9ba9f9b94a0500d, user.id=96c2c75838d94a57943d7400740aeb55) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:54:14.187241 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdaa5b-8af6-45f8-932b-0b5b1b949f06 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:14.190015 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-58fdaa5b-8af6-45f8-932b-0b5b1b949f06 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:14.198030 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 563/1130] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:54:13 2022] GET /identity/v3/role_assignments?user.id=96c2c75838d94a57943d7400740aeb55&scope.project.id=e8e27d583fc14060b9ba9f9b94a0500d&role.id=f186b24dc4eb43668f180c85b7c1fc20 => generated 608 bytes in 199 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:54:16.188605 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529daaf-80e0-453a-9b44-2dc616703bfc None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:16.189362 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529daaf-80e0-453a-9b44-2dc616703bfc None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:16.189362 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a529daaf-80e0-453a-9b44-2dc616703bfc None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:16.190603 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 568/1131] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:54:16 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:54:16.197270 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88cb91-1db3-47c1-8a75-f9ba22d03752 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:16.197803 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88cb91-1db3-47c1-8a75-f9ba22d03752 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:16.197803 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f88cb91-1db3-47c1-8a75-f9ba22d03752 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:16.220605 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-2f88cb91-1db3-47c1-8a75-f9ba22d03752 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:54:16.221846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2f88cb91-1db3-47c1-8a75-f9ba22d03752 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:54:16.291618 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 564/1132] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:54:16 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:54:16.571358 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529daaf-80e0-453a-9b44-2dc616703bfc None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:16.591276 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:16.676082 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a529daaf-80e0-453a-9b44-2dc616703bfc None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:16.711882 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0a70cc87-2f0d-48d9-b8d5-da1352a550ea None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:16.712511 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70cc87-2f0d-48d9-b8d5-da1352a550ea None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:16.712784 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70cc87-2f0d-48d9-b8d5-da1352a550ea None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:16.713076 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0a70cc87-2f0d-48d9-b8d5-da1352a550ea None admin] PATH_INFO: `/v3/domains/default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:16.714212 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70cc87-2f0d-48d9-b8d5-da1352a550ea None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:16.715649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0a70cc87-2f0d-48d9-b8d5-da1352a550ea None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:16.717244 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 569/1133] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:54:16 2022] GET /identity/v3/domains/default => generated 199 bytes in 146 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:16.723579 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88cb91-1db3-47c1-8a75-f9ba22d03752 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:16.783001 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:16.830229 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2f88cb91-1db3-47c1-8a75-f9ba22d03752 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:16.867803 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14abaf84-bc05-4fc0-be3e-2349d21700b4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:16.868414 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abaf84-bc05-4fc0-be3e-2349d21700b4 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:16.868720 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abaf84-bc05-4fc0-be3e-2349d21700b4 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:16.868966 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14abaf84-bc05-4fc0-be3e-2349d21700b4 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:16.869648 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abaf84-bc05-4fc0-be3e-2349d21700b4 None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:16.871159 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14abaf84-bc05-4fc0-be3e-2349d21700b4 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:16.899169 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 565/1134] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 21 00:54:16 2022] POST /identity/v3/projects => generated 311 bytes in 176 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:54:18.843144 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8c926-88f3-48e9-9e2a-755f9ea01331 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:18.843703 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8c926-88f3-48e9-9e2a-755f9ea01331 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:18.843703 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3da8c926-88f3-48e9-9e2a-755f9ea01331 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:18.845062 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 570/1135] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:54:18 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:54:18.850487 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a435d6-8ac6-41f8-91ab-e221ad3036f8 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:18.850909 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a435d6-8ac6-41f8-91ab-e221ad3036f8 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:18.851021 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85a435d6-8ac6-41f8-91ab-e221ad3036f8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:18.870325 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-85a435d6-8ac6-41f8-91ab-e221ad3036f8 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:54:18.871530 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-85a435d6-8ac6-41f8-91ab-e221ad3036f8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:54:18.945636 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 566/1136] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:54:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 96 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:54:19.208627 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8c926-88f3-48e9-9e2a-755f9ea01331 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:19.298457 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:19.315567 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3da8c926-88f3-48e9-9e2a-755f9ea01331 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:19.351635 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cf94e2bf-e625-496a-a211-bf73517b4c84 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:19.352280 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94e2bf-e625-496a-a211-bf73517b4c84 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:19.352544 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94e2bf-e625-496a-a211-bf73517b4c84 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:19.352810 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cf94e2bf-e625-496a-a211-bf73517b4c84 None admin] PATH_INFO: `/v3/domains/default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:19.353999 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94e2bf-e625-496a-a211-bf73517b4c84 None admin] RBAC: Authorizing `identity:get_domain(domain_id=default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:19.355448 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cf94e2bf-e625-496a-a211-bf73517b4c84 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:19.357055 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 571/1137] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:54:19 2022] GET /identity/v3/domains/default => generated 199 bytes in 149 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:19.363078 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a435d6-8ac6-41f8-91ab-e221ad3036f8 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:19.403787 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:19.467452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85a435d6-8ac6-41f8-91ab-e221ad3036f8 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:19.503099 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21961d11-9cdf-4059-b181-386728108005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:19.503712 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21961d11-9cdf-4059-b181-386728108005 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:19.503988 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21961d11-9cdf-4059-b181-386728108005 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:19.504277 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21961d11-9cdf-4059-b181-386728108005 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:19.504908 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21961d11-9cdf-4059-b181-386728108005 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:19.506374 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-21961d11-9cdf-4059-b181-386728108005 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:19.529428 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 567/1138] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 21 00:54:19 2022] POST /identity/v3/users => generated 286 bytes in 167 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:54:21.862737 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db524c51-e4f5-4c6f-be88-e3063d2e994b None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:21.863334 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db524c51-e4f5-4c6f-be88-e3063d2e994b None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:21.863688 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db524c51-e4f5-4c6f-be88-e3063d2e994b None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:21.866182 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 572/1139] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:54:21 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:54:21.874716 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60919043-618e-45be-99b0-bbac2ad19c90 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:21.875860 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60919043-618e-45be-99b0-bbac2ad19c90 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:21.876019 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60919043-618e-45be-99b0-bbac2ad19c90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:21.896560 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-60919043-618e-45be-99b0-bbac2ad19c90 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:54:21.897982 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-60919043-618e-45be-99b0-bbac2ad19c90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:54:21.977455 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 568/1140] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:54:21 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:54:22.249618 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db524c51-e4f5-4c6f-be88-e3063d2e994b None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:22.364697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db524c51-e4f5-4c6f-be88-e3063d2e994b None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:22.405259 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4f6c7-9fe6-4ba0-9bad-d9700e57855d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:22.406079 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4f6c7-9fe6-4ba0-9bad-d9700e57855d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:22.406448 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4f6c7-9fe6-4ba0-9bad-d9700e57855d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:22.406806 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-51d4f6c7-9fe6-4ba0-9bad-d9700e57855d None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:22.419880 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-51d4f6c7-9fe6-4ba0-9bad-d9700e57855d None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:54:22.425354 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-51d4f6c7-9fe6-4ba0-9bad-d9700e57855d None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:54:22.425354 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:54:22.425354 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:54:22.425354 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:54:22.425354 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:54:22.425354 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:54:22.425354 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:54:22.425354 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:54:22.425354 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:54:22.425354 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:54:22.425354 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:54:22.425354 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:54:22.425354 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:54:22.425354 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:54:22.425354 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:54:22.425354 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:54:22.427326 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:54:22.427326 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:54:22.427326 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:54:22.427326 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:54:22.427326 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:54:22.427326 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:54:22.427326 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:54:22.427326 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:54:22.427326 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:54:22.427326 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:54:22.427326 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:54:22.427326 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:54:22.427326 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:54:22.427326 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:54:22.427326 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:54:22.427326 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:54:22.429277 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:54:22.429277 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:54:22.429277 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:54:22.429277 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:54:22.429277 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:54:22.429277 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:54:22.429277 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:54:22.429277 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:54:22.429277 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:54:22.429277 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:54:22.429277 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:54:22.429277 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:54:22.429277 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 573/1141] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:54:22 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:54:22.436288 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60919043-618e-45be-99b0-bbac2ad19c90 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:22.481473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:22.572822 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60919043-618e-45be-99b0-bbac2ad19c90 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:22.611553 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8f5e3-0380-4ef1-b099-34c5b60b919d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:22.612286 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8f5e3-0380-4ef1-b099-34c5b60b919d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:22.612662 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8f5e3-0380-4ef1-b099-34c5b60b919d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:22.613022 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-daf8f5e3-0380-4ef1-b099-34c5b60b919d None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:22.613845 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8f5e3-0380-4ef1-b099-34c5b60b919d None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:54:22.614242 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8f5e3-0380-4ef1-b099-34c5b60b919d None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:22.615707 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-daf8f5e3-0380-4ef1-b099-34c5b60b919d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:22.626382 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 569/1142] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:54:22 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 191 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:22.636207 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4f6c7-9fe6-4ba0-9bad-d9700e57855d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:22.654289 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:22.747593 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-51d4f6c7-9fe6-4ba0-9bad-d9700e57855d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:22.785711 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e765276-1215-4f8b-94ed-107d7da4c3ae None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:22.786498 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e765276-1215-4f8b-94ed-107d7da4c3ae None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:22.786923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e765276-1215-4f8b-94ed-107d7da4c3ae None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:22.787300 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e765276-1215-4f8b-94ed-107d7da4c3ae None admin] PATH_INFO: `/v3/users/ca7c0207b07f40eba85f455f1dc208d0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:22.803345 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e765276-1215-4f8b-94ed-107d7da4c3ae None admin] RBAC: Authorizing `identity:get_user(user_id=ca7c0207b07f40eba85f455f1dc208d0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:22.805014 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9e765276-1215-4f8b-94ed-107d7da4c3ae None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:22.807001 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 574/1143] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:54:22 2022] GET /identity/v3/users/ca7c0207b07f40eba85f455f1dc208d0 => generated 286 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:54:22.817530 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8f5e3-0380-4ef1-b099-34c5b60b919d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:22.970445 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:22.998274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-daf8f5e3-0380-4ef1-b099-34c5b60b919d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:23.050908 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0cc7da-ff9f-446c-b880-7083faddf10e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:23.051926 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cc7da-ff9f-446c-b880-7083faddf10e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:23.052391 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cc7da-ff9f-446c-b880-7083faddf10e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:23.052863 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4b0cc7da-ff9f-446c-b880-7083faddf10e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:23.163277 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0cc7da-ff9f-446c-b880-7083faddf10e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:23.164881 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4b0cc7da-ff9f-446c-b880-7083faddf10e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:23.267852 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:23.285500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 570/1144] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:54:22 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 469 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:54:23.295389 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e765276-1215-4f8b-94ed-107d7da4c3ae None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:23.407740 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:23.460103 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9e765276-1215-4f8b-94ed-107d7da4c3ae None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:23.514645 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4920ae1a-6235-41cc-ab90-747b458605c4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:23.515361 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920ae1a-6235-41cc-ab90-747b458605c4 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:23.515685 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920ae1a-6235-41cc-ab90-747b458605c4 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:23.516009 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4920ae1a-6235-41cc-ab90-747b458605c4 None admin] PATH_INFO: `/v3/projects/fdb1428c68a248b6b5ecc399fe852121` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:23.517420 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4920ae1a-6235-41cc-ab90-747b458605c4 None admin] RBAC: Authorizing `identity:get_project(project_id=fdb1428c68a248b6b5ecc399fe852121)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:23.519055 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4920ae1a-6235-41cc-ab90-747b458605c4 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:23.520881 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 575/1145] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:54:23 2022] GET /identity/v3/projects/fdb1428c68a248b6b5ecc399fe852121 => generated 311 bytes in 227 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:23.528373 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0cc7da-ff9f-446c-b880-7083faddf10e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:23.696211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4b0cc7da-ff9f-446c-b880-7083faddf10e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:23.739718 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c1b23e69-49b9-4008-8cc7-38a89e48c317 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:23.740406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b23e69-49b9-4008-8cc7-38a89e48c317 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:23.740731 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b23e69-49b9-4008-8cc7-38a89e48c317 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:23.741095 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c1b23e69-49b9-4008-8cc7-38a89e48c317 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:23.741866 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b23e69-49b9-4008-8cc7-38a89e48c317 None admin] RBAC: Adding query filter params (role.id=c73e9539582145ed8eedc48648b9d738, scope.project.id=fdb1428c68a248b6b5ecc399fe852121, user.id=ca7c0207b07f40eba85f455f1dc208d0) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:54:23.742222 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b23e69-49b9-4008-8cc7-38a89e48c317 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:23.743748 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c1b23e69-49b9-4008-8cc7-38a89e48c317 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:23.750805 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 571/1146] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:54:23 2022] GET /identity/v3/role_assignments?user.id=ca7c0207b07f40eba85f455f1dc208d0&scope.project.id=fdb1428c68a248b6b5ecc399fe852121&role.id=c73e9539582145ed8eedc48648b9d738 => generated 259 bytes in 224 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:25.711407 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f282e3-cb60-4ddb-bd11-fd2e540dc68b None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:25.711977 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f282e3-cb60-4ddb-bd11-fd2e540dc68b None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:25.711977 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5f282e3-cb60-4ddb-bd11-fd2e540dc68b None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:25.713437 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 576/1147] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:54:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:54:25.719043 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6563882-4c06-4de5-8522-91f00041d19d None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:25.719523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6563882-4c06-4de5-8522-91f00041d19d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:25.719625 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6563882-4c06-4de5-8522-91f00041d19d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:25.739617 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-a6563882-4c06-4de5-8522-91f00041d19d None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:54:25.740819 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a6563882-4c06-4de5-8522-91f00041d19d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:54:25.795007 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:25.819399 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 572/1148] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:54:25 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 101 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:54:26.089119 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f282e3-cb60-4ddb-bd11-fd2e540dc68b None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:26.207755 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5f282e3-cb60-4ddb-bd11-fd2e540dc68b None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:26.257675 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87faad50-a15d-4eba-88a5-60850750dfc0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:26.258374 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87faad50-a15d-4eba-88a5-60850750dfc0 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:26.258690 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87faad50-a15d-4eba-88a5-60850750dfc0 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:26.259010 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87faad50-a15d-4eba-88a5-60850750dfc0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:26.269378 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:26.274121 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-87faad50-a15d-4eba-88a5-60850750dfc0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:54:26.279582 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-87faad50-a15d-4eba-88a5-60850750dfc0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:54:26.279582 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:54:26.279582 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:54:26.279582 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:54:26.279582 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:54:26.279582 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:54:26.279582 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:54:26.279582 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:54:26.279582 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:54:26.279582 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:54:26.279582 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:54:26.279582 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:54:26.279582 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:54:26.279582 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:54:26.279582 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:54:26.279582 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:54:26.281399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:54:26.281399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:54:26.281399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:54:26.281399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:54:26.281399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:54:26.281399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:54:26.281399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:54:26.281399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:54:26.281399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:54:26.281399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:54:26.281399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:54:26.281399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:54:26.281399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:54:26.281399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:54:26.281399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:54:26.281399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:54:26.282394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:54:26.282394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:54:26.282394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:54:26.282394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:54:26.282394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:54:26.282394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:54:26.282394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:54:26.282394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:54:26.282394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:54:26.282394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:54:26.282394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:54:26.282394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:54:26.282394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 577/1149] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:54:26 2022] GET /identity/v3/roles/admin => generated 83 bytes in 193 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:54:26.291160 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6563882-4c06-4de5-8522-91f00041d19d None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:26.414909 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6563882-4c06-4de5-8522-91f00041d19d None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:26.456246 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06dddc-eb97-4c7f-a76c-c82a07f0bb31 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:26.456921 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06dddc-eb97-4c7f-a76c-c82a07f0bb31 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:26.457237 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06dddc-eb97-4c7f-a76c-c82a07f0bb31 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:26.457512 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a06dddc-eb97-4c7f-a76c-c82a07f0bb31 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:26.458213 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06dddc-eb97-4c7f-a76c-c82a07f0bb31 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:54:26.458517 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06dddc-eb97-4c7f-a76c-c82a07f0bb31 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:26.459939 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6a06dddc-eb97-4c7f-a76c-c82a07f0bb31 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:26.470873 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 573/1150] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:54:26 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 180 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:54:26.478400 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87faad50-a15d-4eba-88a5-60850750dfc0 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:26.675225 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87faad50-a15d-4eba-88a5-60850750dfc0 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:26.720236 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3793b9-85d1-4fb8-95a6-42a504c381eb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:26.721324 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3793b9-85d1-4fb8-95a6-42a504c381eb None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:26.721324 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3793b9-85d1-4fb8-95a6-42a504c381eb None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:26.721643 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da3793b9-85d1-4fb8-95a6-42a504c381eb None admin] PATH_INFO: `/v3/users/ca7c0207b07f40eba85f455f1dc208d0` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:26.722927 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3793b9-85d1-4fb8-95a6-42a504c381eb None admin] RBAC: Authorizing `identity:get_user(user_id=ca7c0207b07f40eba85f455f1dc208d0)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:26.724533 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da3793b9-85d1-4fb8-95a6-42a504c381eb None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:26.726477 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 578/1151] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:54:26 2022] GET /identity/v3/users/ca7c0207b07f40eba85f455f1dc208d0 => generated 286 bytes in 249 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:26.735940 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06dddc-eb97-4c7f-a76c-c82a07f0bb31 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:26.784606 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:26.882756 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6a06dddc-eb97-4c7f-a76c-c82a07f0bb31 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:26.940513 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2094fc24-ae89-4cbe-903c-30a6bb3706a5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:26.941478 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094fc24-ae89-4cbe-903c-30a6bb3706a5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:26.941969 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094fc24-ae89-4cbe-903c-30a6bb3706a5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:26.942452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2094fc24-ae89-4cbe-903c-30a6bb3706a5 None admin] PATH_INFO: `/v3/projects/fdb1428c68a248b6b5ecc399fe852121` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:26.944506 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094fc24-ae89-4cbe-903c-30a6bb3706a5 None admin] RBAC: Authorizing `identity:get_project(project_id=fdb1428c68a248b6b5ecc399fe852121)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:26.947225 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2094fc24-ae89-4cbe-903c-30a6bb3706a5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:26.950407 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 574/1152] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:54:26 2022] GET /identity/v3/projects/fdb1428c68a248b6b5ecc399fe852121 => generated 311 bytes in 215 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:26.960604 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3793b9-85d1-4fb8-95a6-42a504c381eb None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:27.048378 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:27.086106 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da3793b9-85d1-4fb8-95a6-42a504c381eb None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:27.124493 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-015d6988-9e97-43ea-813f-4bef0a7b2072 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:27.125620 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d6988-9e97-43ea-813f-4bef0a7b2072 None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:27.125951 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d6988-9e97-43ea-813f-4bef0a7b2072 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:27.126268 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-015d6988-9e97-43ea-813f-4bef0a7b2072 None admin] PATH_INFO: `/v3/projects/fdb1428c68a248b6b5ecc399fe852121/users/ca7c0207b07f40eba85f455f1dc208d0/roles/c73e9539582145ed8eedc48648b9d738` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:27.128371 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d6988-9e97-43ea-813f-4bef0a7b2072 None admin] RBAC: Authorizing `identity:create_grant(project_id=fdb1428c68a248b6b5ecc399fe852121, user_id=ca7c0207b07f40eba85f455f1dc208d0, role_id=c73e9539582145ed8eedc48648b9d738)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:27.129954 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-015d6988-9e97-43ea-813f-4bef0a7b2072 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:27.147182 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 579/1153] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 21 00:54:26 2022] PUT /identity/v3/projects/fdb1428c68a248b6b5ecc399fe852121/users/ca7c0207b07f40eba85f455f1dc208d0/roles/c73e9539582145ed8eedc48648b9d738 => generated 0 bytes in 188 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:54:29.152316 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badddad-d8a7-44f5-a5fc-31bade3d037c None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:29.152919 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badddad-d8a7-44f5-a5fc-31bade3d037c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:29.152919 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0badddad-d8a7-44f5-a5fc-31bade3d037c None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:29.154466 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 575/1154] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:54:29 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:54:29.160555 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d22fcd-070d-487e-8007-a723297e7521 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:29.161234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d22fcd-070d-487e-8007-a723297e7521 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:29.161234 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8d22fcd-070d-487e-8007-a723297e7521 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:29.180467 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-c8d22fcd-070d-487e-8007-a723297e7521 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:54:29.181778 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c8d22fcd-070d-487e-8007-a723297e7521 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:54:29.261175 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 580/1155] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:54:29 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:54:29.532853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0badddad-d8a7-44f5-a5fc-31bade3d037c None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:29.643413 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0badddad-d8a7-44f5-a5fc-31bade3d037c None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:29.655144 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:29.685576 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783daa4-c64d-497d-a28f-bc8f79d9cfe6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:29.686274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783daa4-c64d-497d-a28f-bc8f79d9cfe6 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:29.686593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783daa4-c64d-497d-a28f-bc8f79d9cfe6 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:29.686937 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1783daa4-c64d-497d-a28f-bc8f79d9cfe6 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:29.700584 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1783daa4-c64d-497d-a28f-bc8f79d9cfe6 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:54:29.708747 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-1783daa4-c64d-497d-a28f-bc8f79d9cfe6 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:54:29.708747 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:54:29.708747 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:54:29.708747 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:54:29.708747 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:54:29.708747 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:54:29.708747 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:54:29.708747 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:54:29.708747 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:54:29.708747 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:54:29.708747 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:54:29.708747 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:54:29.708747 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:54:29.708747 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:54:29.708747 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:54:29.708747 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:54:29.710964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:54:29.710964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:54:29.710964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:54:29.710964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:54:29.710964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:54:29.710964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:54:29.710964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:54:29.710964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:54:29.710964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:54:29.710964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:54:29.710964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:54:29.710964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:54:29.710964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:54:29.710964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:54:29.710964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:54:29.710964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:54:29.712950 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:54:29.712950 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:54:29.712950 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:54:29.712950 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:54:29.712950 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:54:29.712950 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:54:29.712950 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:54:29.712950 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:54:29.712950 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:54:29.712950 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:54:29.712950 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:54:29.712950 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:54:29.712950 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 576/1156] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:54:29 2022] GET /identity/v3/roles/admin => generated 83 bytes in 178 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:54:29.719615 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d22fcd-070d-487e-8007-a723297e7521 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:29.831641 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:29.909449 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8d22fcd-070d-487e-8007-a723297e7521 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:29.973883 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d64592-f91e-40fd-973e-7a1fff7bf9bb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:29.974941 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d64592-f91e-40fd-973e-7a1fff7bf9bb None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:29.975426 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d64592-f91e-40fd-973e-7a1fff7bf9bb None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:29.975912 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9d64592-f91e-40fd-973e-7a1fff7bf9bb None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:29.977163 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d64592-f91e-40fd-973e-7a1fff7bf9bb None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:54:29.977729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d64592-f91e-40fd-973e-7a1fff7bf9bb None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:29.980439 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a9d64592-f91e-40fd-973e-7a1fff7bf9bb None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:29.996752 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 581/1157] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:54:29 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:30.006564 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783daa4-c64d-497d-a28f-bc8f79d9cfe6 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:30.167877 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1783daa4-c64d-497d-a28f-bc8f79d9cfe6 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:30.224957 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae35fb-b327-4646-a5a9-e154f468ec1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:30.225757 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae35fb-b327-4646-a5a9-e154f468ec1b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:30.226080 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae35fb-b327-4646-a5a9-e154f468ec1b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:30.226525 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ae35fb-b327-4646-a5a9-e154f468ec1b None admin] PATH_INFO: `/v3/users/ca7c0207b07f40eba85f455f1dc208d0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:30.227885 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae35fb-b327-4646-a5a9-e154f468ec1b None admin] RBAC: Authorizing `identity:get_user(user_id=ca7c0207b07f40eba85f455f1dc208d0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:30.229676 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31ae35fb-b327-4646-a5a9-e154f468ec1b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:30.231657 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 577/1158] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:54:30 2022] GET /identity/v3/users/ca7c0207b07f40eba85f455f1dc208d0 => generated 286 bytes in 226 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:30.238026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d64592-f91e-40fd-973e-7a1fff7bf9bb None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:30.355171 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9d64592-f91e-40fd-973e-7a1fff7bf9bb None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:30.379632 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:30.408308 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089793c-2cf8-4a1b-bc57-94e1b4068ed0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:30.409393 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089793c-2cf8-4a1b-bc57-94e1b4068ed0 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:30.409877 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089793c-2cf8-4a1b-bc57-94e1b4068ed0 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:30.410344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5089793c-2cf8-4a1b-bc57-94e1b4068ed0 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:30.504336 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089793c-2cf8-4a1b-bc57-94e1b4068ed0 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:30.506080 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5089793c-2cf8-4a1b-bc57-94e1b4068ed0 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:30.615273 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 582/1159] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:54:30 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 378 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:54:30.622165 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae35fb-b327-4646-a5a9-e154f468ec1b None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:30.674184 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:30.750193 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31ae35fb-b327-4646-a5a9-e154f468ec1b None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:30.790073 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5432838-4722-4016-8d69-f89c61212bb8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:30.790608 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5432838-4722-4016-8d69-f89c61212bb8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:30.790891 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5432838-4722-4016-8d69-f89c61212bb8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:30.791164 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5432838-4722-4016-8d69-f89c61212bb8 None admin] PATH_INFO: `/v3/projects/fdb1428c68a248b6b5ecc399fe852121` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:30.792448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5432838-4722-4016-8d69-f89c61212bb8 None admin] RBAC: Authorizing `identity:get_project(project_id=fdb1428c68a248b6b5ecc399fe852121)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:30.793943 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d5432838-4722-4016-8d69-f89c61212bb8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:30.795674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 578/1160] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:54:30 2022] GET /identity/v3/projects/fdb1428c68a248b6b5ecc399fe852121 => generated 311 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:54:30.802652 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089793c-2cf8-4a1b-bc57-94e1b4068ed0 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:30.825780 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:30.930337 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5089793c-2cf8-4a1b-bc57-94e1b4068ed0 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:30.967131 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a602107f-1002-485e-a405-5421c283afcc None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:30.967742 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602107f-1002-485e-a405-5421c283afcc None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:30.968014 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602107f-1002-485e-a405-5421c283afcc None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:30.968273 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a602107f-1002-485e-a405-5421c283afcc None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:30.969009 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602107f-1002-485e-a405-5421c283afcc None admin] RBAC: Adding query filter params (role.id=c73e9539582145ed8eedc48648b9d738, scope.project.id=fdb1428c68a248b6b5ecc399fe852121, user.id=ca7c0207b07f40eba85f455f1dc208d0) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:54:30.969353 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602107f-1002-485e-a405-5421c283afcc None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:30.970800 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a602107f-1002-485e-a405-5421c283afcc None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:30.978924 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 583/1161] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:54:30 2022] GET /identity/v3/role_assignments?user.id=ca7c0207b07f40eba85f455f1dc208d0&scope.project.id=fdb1428c68a248b6b5ecc399fe852121&role.id=c73e9539582145ed8eedc48648b9d738 => generated 608 bytes in 177 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:33.240617 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a93e3-e9f4-4a19-a15d-c21e3b88f58f None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:33.241284 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a93e3-e9f4-4a19-a15d-c21e3b88f58f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:33.241284 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-686a93e3-e9f4-4a19-a15d-c21e3b88f58f None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:33.242554 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 579/1162] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:54:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:54:33.248637 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1817d-42e8-4799-aef3-0ced24309423 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:33.249260 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1817d-42e8-4799-aef3-0ced24309423 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:33.249260 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efa1817d-42e8-4799-aef3-0ced24309423 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:33.269167 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-efa1817d-42e8-4799-aef3-0ced24309423 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:54:33.270400 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-efa1817d-42e8-4799-aef3-0ced24309423 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:54:33.345477 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 584/1163] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:54:33 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 98 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:54:33.612912 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a93e3-e9f4-4a19-a15d-c21e3b88f58f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:33.724210 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-686a93e3-e9f4-4a19-a15d-c21e3b88f58f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:33.731696 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:33.761883 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbae35-224a-4741-af1c-12717784962e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:33.762512 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbae35-224a-4741-af1c-12717784962e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:33.762801 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbae35-224a-4741-af1c-12717784962e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:33.763068 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cdbbae35-224a-4741-af1c-12717784962e None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:33.835946 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbae35-224a-4741-af1c-12717784962e None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:33.837534 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cdbbae35-224a-4741-af1c-12717784962e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:33.945235 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 580/1164] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:54:33 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 333 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:54:33.951872 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1817d-42e8-4799-aef3-0ced24309423 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:33.968836 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:34.083421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efa1817d-42e8-4799-aef3-0ced24309423 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:34.121744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56aa67a8-30fc-493e-81aa-32f3c6f7d3e4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:34.122389 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa67a8-30fc-493e-81aa-32f3c6f7d3e4 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:34.122665 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa67a8-30fc-493e-81aa-32f3c6f7d3e4 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:34.122932 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56aa67a8-30fc-493e-81aa-32f3c6f7d3e4 None admin] PATH_INFO: `/v3/domains/swift_test` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:34.130897 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa67a8-30fc-493e-81aa-32f3c6f7d3e4 None admin] RBAC: Authorizing `identity:get_domain(domain_id=swift_test)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:34.132463 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-56aa67a8-30fc-493e-81aa-32f3c6f7d3e4 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:34.144649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-56aa67a8-30fc-493e-81aa-32f3c6f7d3e4 None admin] Could not find domain: swift_test.: keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 21 00:54:34.144649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:54:34.144649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 712, in get_domain Aug 21 00:54:34.144649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = self.driver.get_project(domain_id) Aug 21 00:54:34.144649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:54:34.144649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:54:34.144649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:54:34.144649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:54:34.144649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: swift_test. Aug 21 00:54:34.144649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:54:34.144649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:54:34.144649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:54:34.144649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:54:34.144649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:54:34.144649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:54:34.144649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:54:34.144649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:54:34.146559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:54:34.146559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:54:34.146559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:54:34.146559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:54:34.146559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:54:34.146559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:54:34.146559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:54:34.146559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:54:34.146559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:54:34.146559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:54:34.146559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:54:34.146559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:54:34.146559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:54:34.146559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:54:34.146559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:54:34.146559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:54:34.148344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:54:34.148344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:54:34.148344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:54:34.148344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:54:34.148344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:54:34.148344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:54:34.148344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:54:34.148344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:54:34.148344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:54:34.148344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:54:34.148344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 718, in get_domain Aug 21 00:54:34.148344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:54:34.148344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: swift_test. Aug 21 00:54:34.148344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:54:34.148344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 585/1165] 10.222.0.49 () {56 vars in 1117 bytes} [Sun Aug 21 00:54:33 2022] GET /identity/v3/domains/swift_test => generated 90 bytes in 195 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:54:34.152340 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbae35-224a-4741-af1c-12717784962e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:34.161318 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:34.264336 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cdbbae35-224a-4741-af1c-12717784962e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:34.303051 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-64c1b5ca-720c-4848-b837-5f9eb2e6840c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:34.304038 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1b5ca-720c-4848-b837-5f9eb2e6840c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:34.304520 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1b5ca-720c-4848-b837-5f9eb2e6840c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:34.304992 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-64c1b5ca-720c-4848-b837-5f9eb2e6840c None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:34.306179 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c1b5ca-720c-4848-b837-5f9eb2e6840c None admin] RBAC: Adding query filter params (name=swift_test) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:54:34.306703 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c1b5ca-720c-4848-b837-5f9eb2e6840c None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:34.309386 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-64c1b5ca-720c-4848-b837-5f9eb2e6840c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:34.322745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 581/1166] 10.222.0.49 () {56 vars in 1115 bytes} [Sun Aug 21 00:54:34 2022] GET /identity/v3/domains?name=swift_test => generated 125 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:36.311928 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe4769-3ab3-4275-a440-daddd07d09e2 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:36.312497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe4769-3ab3-4275-a440-daddd07d09e2 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:36.312497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bfbe4769-3ab3-4275-a440-daddd07d09e2 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:36.314091 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 586/1167] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:54:36 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:54:36.320216 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa2b6a-52e4-45af-890f-4ed8e2de2b9e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:36.320780 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa2b6a-52e4-45af-890f-4ed8e2de2b9e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:36.320780 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1caa2b6a-52e4-45af-890f-4ed8e2de2b9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:36.339791 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-1caa2b6a-52e4-45af-890f-4ed8e2de2b9e None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:54:36.340983 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1caa2b6a-52e4-45af-890f-4ed8e2de2b9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:54:36.415349 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:36.421373 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 582/1168] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:54:36 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:54:36.688541 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe4769-3ab3-4275-a440-daddd07d09e2 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:36.781957 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:36.815658 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bfbe4769-3ab3-4275-a440-daddd07d09e2 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:36.855844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9697d431-8740-41d1-afe9-520d6ffe6b26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:36.856464 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697d431-8740-41d1-afe9-520d6ffe6b26 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:36.856742 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697d431-8740-41d1-afe9-520d6ffe6b26 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:36.857015 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9697d431-8740-41d1-afe9-520d6ffe6b26 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:36.857742 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9697d431-8740-41d1-afe9-520d6ffe6b26 None admin] RBAC: Authorizing `identity:create_domain()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:36.859143 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9697d431-8740-41d1-afe9-520d6ffe6b26 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:36.881134 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 587/1169] 10.222.0.49 () {60 vars in 1138 bytes} [Sun Aug 21 00:54:36 2022] POST /identity/v3/domains => generated 267 bytes in 193 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:54:38.912261 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088bcb6-0f63-4a15-8616-e968d4a68b5b None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:38.913155 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088bcb6-0f63-4a15-8616-e968d4a68b5b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:38.913155 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4088bcb6-0f63-4a15-8616-e968d4a68b5b None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:38.914714 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 583/1170] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:54:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:54:38.924135 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215f6d2-5a4e-4bbd-ab58-16ba1fdd8f7d None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:38.924675 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215f6d2-5a4e-4bbd-ab58-16ba1fdd8f7d None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:38.925077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d215f6d2-5a4e-4bbd-ab58-16ba1fdd8f7d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:38.955811 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-d215f6d2-5a4e-4bbd-ab58-16ba1fdd8f7d None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:54:38.957946 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d215f6d2-5a4e-4bbd-ab58-16ba1fdd8f7d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:54:39.090978 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 588/1171] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:54:38 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 169 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:54:39.581955 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088bcb6-0f63-4a15-8616-e968d4a68b5b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:39.765754 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4088bcb6-0f63-4a15-8616-e968d4a68b5b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:39.833812 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b958d8c-a81a-468b-90e4-0bb724a97d1b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:39.834794 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b958d8c-a81a-468b-90e4-0bb724a97d1b None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:39.835275 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b958d8c-a81a-468b-90e4-0bb724a97d1b None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:39.835794 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b958d8c-a81a-468b-90e4-0bb724a97d1b None admin] PATH_INFO: `/v3/domains/158ff454ea0040a38e48f5630ffd57d0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:39.857818 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b958d8c-a81a-468b-90e4-0bb724a97d1b None admin] RBAC: Authorizing `identity:get_domain(domain_id=158ff454ea0040a38e48f5630ffd57d0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:39.860881 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5b958d8c-a81a-468b-90e4-0bb724a97d1b None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:39.864151 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 584/1172] 10.222.0.49 () {56 vars in 1183 bytes} [Sun Aug 21 00:54:39 2022] GET /identity/v3/domains/158ff454ea0040a38e48f5630ffd57d0 => generated 267 bytes in 284 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:39.874582 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215f6d2-5a4e-4bbd-ab58-16ba1fdd8f7d None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:39.959703 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:40.014356 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d215f6d2-5a4e-4bbd-ab58-16ba1fdd8f7d None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:40.058402 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-efc77896-4051-4f11-8269-4fad1704371f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:40.059165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc77896-4051-4f11-8269-4fad1704371f None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:40.059538 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc77896-4051-4f11-8269-4fad1704371f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:40.059906 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-efc77896-4051-4f11-8269-4fad1704371f None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:40.060669 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc77896-4051-4f11-8269-4fad1704371f None admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:40.062314 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-efc77896-4051-4f11-8269-4fad1704371f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:40.094039 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 589/1173] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 21 00:54:39 2022] POST /identity/v3/projects => generated 361 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:54:42.178221 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1500f-3038-4ff1-8aa4-915ae1419932 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:42.179085 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1500f-3038-4ff1-8aa4-915ae1419932 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:42.179085 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c0d1500f-3038-4ff1-8aa4-915ae1419932 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:42.180660 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 585/1174] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:54:42 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:54:42.187983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab242ac-c2ec-4fb6-af40-0851a245288e None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:42.188603 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab242ac-c2ec-4fb6-af40-0851a245288e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:42.188939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dab242ac-c2ec-4fb6-af40-0851a245288e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:42.219909 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-dab242ac-c2ec-4fb6-af40-0851a245288e None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:54:42.221955 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-dab242ac-c2ec-4fb6-af40-0851a245288e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:54:42.322157 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 590/1175] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:54:42 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 136 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:54:42.606339 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1500f-3038-4ff1-8aa4-915ae1419932 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:42.674536 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:42.730156 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c0d1500f-3038-4ff1-8aa4-915ae1419932 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:42.773809 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80c4fe63-56fb-44d2-b7b4-cd100ef59156 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:42.774611 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4fe63-56fb-44d2-b7b4-cd100ef59156 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:42.774997 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4fe63-56fb-44d2-b7b4-cd100ef59156 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:42.775362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80c4fe63-56fb-44d2-b7b4-cd100ef59156 None admin] PATH_INFO: `/v3/domains/158ff454ea0040a38e48f5630ffd57d0` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:42.776871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4fe63-56fb-44d2-b7b4-cd100ef59156 None admin] RBAC: Authorizing `identity:get_domain(domain_id=158ff454ea0040a38e48f5630ffd57d0)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:42.778554 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80c4fe63-56fb-44d2-b7b4-cd100ef59156 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:42.780483 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 586/1176] 10.222.0.49 () {56 vars in 1183 bytes} [Sun Aug 21 00:54:42 2022] GET /identity/v3/domains/158ff454ea0040a38e48f5630ffd57d0 => generated 267 bytes in 175 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:54:42.790479 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab242ac-c2ec-4fb6-af40-0851a245288e None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:42.846916 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:42.912866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dab242ac-c2ec-4fb6-af40-0851a245288e None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:42.958940 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a4773cc1-7b08-4bf4-a351-4eeb99714972 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:42.959572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4773cc1-7b08-4bf4-a351-4eeb99714972 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:42.959852 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4773cc1-7b08-4bf4-a351-4eeb99714972 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:42.960176 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a4773cc1-7b08-4bf4-a351-4eeb99714972 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:42.960901 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4773cc1-7b08-4bf4-a351-4eeb99714972 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:42.962811 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a4773cc1-7b08-4bf4-a351-4eeb99714972 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:42.994862 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 591/1177] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 21 00:54:42 2022] POST /identity/v3/users => generated 311 bytes in 205 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:54:45.029386 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807f1a5-4edc-4728-929e-1daed76be586 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:45.030255 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807f1a5-4edc-4728-929e-1daed76be586 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:45.030255 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7807f1a5-4edc-4728-929e-1daed76be586 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:45.031880 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 587/1178] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:54:45 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:54:45.037988 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34563c-6b05-401b-bc36-e4d3f5ef44a7 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:45.038807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34563c-6b05-401b-bc36-e4d3f5ef44a7 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:45.038807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bc34563c-6b05-401b-bc36-e4d3f5ef44a7 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:45.059052 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-bc34563c-6b05-401b-bc36-e4d3f5ef44a7 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:54:45.060284 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-bc34563c-6b05-401b-bc36-e4d3f5ef44a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:54:45.138564 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 592/1179] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:54:45 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 102 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:54:45.630107 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807f1a5-4edc-4728-929e-1daed76be586 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:45.800815 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7807f1a5-4edc-4728-929e-1daed76be586 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:45.842994 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:45.853089 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6355e-d9cb-4719-aaf4-909be50407ac None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:45.854053 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6355e-d9cb-4719-aaf4-909be50407ac None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:45.854542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6355e-d9cb-4719-aaf4-909be50407ac None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:45.854944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8d6355e-d9cb-4719-aaf4-909be50407ac None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:45.868380 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8d6355e-d9cb-4719-aaf4-909be50407ac None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:54:45.873845 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-a8d6355e-d9cb-4719-aaf4-909be50407ac None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:54:45.873845 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:54:45.873845 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:54:45.873845 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:54:45.873845 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:54:45.873845 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:54:45.873845 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:54:45.873845 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:54:45.873845 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:54:45.873845 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:54:45.873845 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:54:45.873845 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:54:45.873845 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:54:45.873845 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:54:45.873845 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:54:45.873845 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:54:45.876315 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:54:45.876315 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:54:45.876315 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:54:45.876315 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:54:45.876315 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:54:45.876315 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:54:45.876315 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:54:45.876315 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:54:45.876315 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:54:45.876315 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:54:45.876315 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:54:45.876315 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:54:45.876315 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:54:45.876315 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:54:45.876315 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:54:45.876315 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:54:45.878364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:54:45.878364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:54:45.878364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:54:45.878364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:54:45.878364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:54:45.878364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:54:45.878364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:54:45.878364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:54:45.878364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:54:45.878364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:54:45.878364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:54:45.878364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:54:45.878364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 588/1180] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:54:45 2022] GET /identity/v3/roles/admin => generated 83 bytes in 246 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:54:45.885148 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34563c-6b05-401b-bc36-e4d3f5ef44a7 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:45.922175 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:46.048844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bc34563c-6b05-401b-bc36-e4d3f5ef44a7 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:46.091423 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae9620-4bfe-4e66-a4e9-8e0594e61ace None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:46.092181 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae9620-4bfe-4e66-a4e9-8e0594e61ace None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:46.092559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae9620-4bfe-4e66-a4e9-8e0594e61ace None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:46.092920 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eeae9620-4bfe-4e66-a4e9-8e0594e61ace None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:46.093871 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae9620-4bfe-4e66-a4e9-8e0594e61ace None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:54:46.094274 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae9620-4bfe-4e66-a4e9-8e0594e61ace None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:46.095820 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eeae9620-4bfe-4e66-a4e9-8e0594e61ace None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:46.106325 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 593/1181] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:54:45 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:54:46.116034 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6355e-d9cb-4719-aaf4-909be50407ac None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:46.284432 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8d6355e-d9cb-4719-aaf4-909be50407ac None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:46.326221 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18f12c-d17f-4efa-85ba-c9933db30bb1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:46.329465 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18f12c-d17f-4efa-85ba-c9933db30bb1 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:46.329852 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18f12c-d17f-4efa-85ba-c9933db30bb1 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:46.331302 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f18f12c-d17f-4efa-85ba-c9933db30bb1 None admin] PATH_INFO: `/v3/users/8f0ce32e4f9341ffbb5163a345184dee` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:46.353093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18f12c-d17f-4efa-85ba-c9933db30bb1 None admin] RBAC: Authorizing `identity:get_user(user_id=8f0ce32e4f9341ffbb5163a345184dee)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:46.355051 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f18f12c-d17f-4efa-85ba-c9933db30bb1 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:46.356865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 589/1182] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:54:46 2022] GET /identity/v3/users/8f0ce32e4f9341ffbb5163a345184dee => generated 311 bytes in 242 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:46.363902 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae9620-4bfe-4e66-a4e9-8e0594e61ace None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:46.532895 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:46.545405 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eeae9620-4bfe-4e66-a4e9-8e0594e61ace None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:46.616310 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983c3fa-6f4b-423d-bf95-607481160258 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:46.617415 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983c3fa-6f4b-423d-bf95-607481160258 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:46.617925 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983c3fa-6f4b-423d-bf95-607481160258 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:46.618420 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0983c3fa-6f4b-423d-bf95-607481160258 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:46.745299 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983c3fa-6f4b-423d-bf95-607481160258 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:46.748108 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0983c3fa-6f4b-423d-bf95-607481160258 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:46.886379 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:46.895319 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 594/1183] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:54:46 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 532 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:54:46.904668 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18f12c-d17f-4efa-85ba-c9933db30bb1 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:46.957552 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:47.017691 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f18f12c-d17f-4efa-85ba-c9933db30bb1 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:47.056506 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-98b9974a-16dc-4859-9dbf-5fb630dd61b7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:47.057323 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9974a-16dc-4859-9dbf-5fb630dd61b7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:47.057779 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9974a-16dc-4859-9dbf-5fb630dd61b7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:47.058136 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98b9974a-16dc-4859-9dbf-5fb630dd61b7 None admin] PATH_INFO: `/v3/projects/95765b05580b4ba6b95bab7fca7b6cd8` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:47.059472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9974a-16dc-4859-9dbf-5fb630dd61b7 None admin] RBAC: Authorizing `identity:get_project(project_id=95765b05580b4ba6b95bab7fca7b6cd8)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:47.061001 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-98b9974a-16dc-4859-9dbf-5fb630dd61b7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:47.062791 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 590/1184] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:54:46 2022] GET /identity/v3/projects/95765b05580b4ba6b95bab7fca7b6cd8 => generated 361 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:47.073199 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983c3fa-6f4b-423d-bf95-607481160258 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:47.214710 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0983c3fa-6f4b-423d-bf95-607481160258 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:47.276556 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-15c3fb07-afcb-422b-8759-07c85dc70fb7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:47.277599 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3fb07-afcb-422b-8759-07c85dc70fb7 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:47.278074 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3fb07-afcb-422b-8759-07c85dc70fb7 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:47.278540 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15c3fb07-afcb-422b-8759-07c85dc70fb7 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:47.279919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3fb07-afcb-422b-8759-07c85dc70fb7 None admin] RBAC: Adding query filter params (role.id=c73e9539582145ed8eedc48648b9d738, scope.project.id=95765b05580b4ba6b95bab7fca7b6cd8, user.id=8f0ce32e4f9341ffbb5163a345184dee) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:54:47.280470 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3fb07-afcb-422b-8759-07c85dc70fb7 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:47.283125 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-15c3fb07-afcb-422b-8759-07c85dc70fb7 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:47.293766 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 595/1185] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:54:47 2022] GET /identity/v3/role_assignments?user.id=8f0ce32e4f9341ffbb5163a345184dee&scope.project.id=95765b05580b4ba6b95bab7fca7b6cd8&role.id=c73e9539582145ed8eedc48648b9d738 => generated 259 bytes in 222 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:49.327874 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036b44e-f155-4fa5-8037-ce67009bdc78 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:49.328672 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036b44e-f155-4fa5-8037-ce67009bdc78 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:49.328831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6036b44e-f155-4fa5-8037-ce67009bdc78 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:49.331348 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 591/1186] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:54:49 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:54:49.341694 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604af88-b611-4e3d-8229-fc517a86f0bc None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:49.342501 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604af88-b611-4e3d-8229-fc517a86f0bc None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:49.342657 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6604af88-b611-4e3d-8229-fc517a86f0bc None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:49.372875 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-6604af88-b611-4e3d-8229-fc517a86f0bc None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:54:49.374946 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-6604af88-b611-4e3d-8229-fc517a86f0bc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:54:49.463113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:49.491385 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 596/1187] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:54:49 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 152 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:54:49.762051 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036b44e-f155-4fa5-8037-ce67009bdc78 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:49.887413 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6036b44e-f155-4fa5-8037-ce67009bdc78 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:49.903917 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:49.926865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99694979-a4c1-470c-81ca-6066f672597c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:49.927529 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99694979-a4c1-470c-81ca-6066f672597c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:49.927798 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99694979-a4c1-470c-81ca-6066f672597c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:49.928065 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-99694979-a4c1-470c-81ca-6066f672597c None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:49.947305 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-99694979-a4c1-470c-81ca-6066f672597c None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:54:49.963583 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-99694979-a4c1-470c-81ca-6066f672597c None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:54:49.963583 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:54:49.963583 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:54:49.963583 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:54:49.963583 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:54:49.963583 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:54:49.963583 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:54:49.963583 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:54:49.963583 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:54:49.963583 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:54:49.963583 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:54:49.963583 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:54:49.963583 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:54:49.963583 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:54:49.963583 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:54:49.963583 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:54:49.965483 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:54:49.965483 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:54:49.965483 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:54:49.965483 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:54:49.965483 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:54:49.965483 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:54:49.965483 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:54:49.965483 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:54:49.965483 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:54:49.965483 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:54:49.965483 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:54:49.965483 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:54:49.965483 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:54:49.965483 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:54:49.965483 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:54:49.965483 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:54:49.967104 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:54:49.967104 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:54:49.967104 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:54:49.967104 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:54:49.967104 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:54:49.967104 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:54:49.967104 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:54:49.967104 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:54:49.967104 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:54:49.967104 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:54:49.967104 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:54:49.967104 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:54:49.967104 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 592/1188] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:54:49 2022] GET /identity/v3/roles/admin => generated 83 bytes in 204 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:54:49.972215 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604af88-b611-4e3d-8229-fc517a86f0bc None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:50.103175 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6604af88-b611-4e3d-8229-fc517a86f0bc None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:50.147315 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb93b8-90d4-4c2d-be87-2bf31355ef76 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:50.148015 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb93b8-90d4-4c2d-be87-2bf31355ef76 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:50.148342 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb93b8-90d4-4c2d-be87-2bf31355ef76 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:50.148661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-20fb93b8-90d4-4c2d-be87-2bf31355ef76 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:50.149480 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb93b8-90d4-4c2d-be87-2bf31355ef76 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:54:50.149826 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb93b8-90d4-4c2d-be87-2bf31355ef76 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:50.151420 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-20fb93b8-90d4-4c2d-be87-2bf31355ef76 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:50.162088 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 597/1189] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:54:49 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 190 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:50.169522 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99694979-a4c1-470c-81ca-6066f672597c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:50.311867 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-99694979-a4c1-470c-81ca-6066f672597c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:50.350212 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee163b-0898-4c04-99d1-89c280799970 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:50.350951 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee163b-0898-4c04-99d1-89c280799970 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:50.351090 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee163b-0898-4c04-99d1-89c280799970 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:50.351357 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85ee163b-0898-4c04-99d1-89c280799970 None admin] PATH_INFO: `/v3/users/8f0ce32e4f9341ffbb5163a345184dee` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:50.352576 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee163b-0898-4c04-99d1-89c280799970 None admin] RBAC: Authorizing `identity:get_user(user_id=8f0ce32e4f9341ffbb5163a345184dee)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:50.354133 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85ee163b-0898-4c04-99d1-89c280799970 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:50.355807 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 593/1190] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:54:50 2022] GET /identity/v3/users/8f0ce32e4f9341ffbb5163a345184dee => generated 311 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:50.362084 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb93b8-90d4-4c2d-be87-2bf31355ef76 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:50.417808 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:50.469931 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-20fb93b8-90d4-4c2d-be87-2bf31355ef76 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:50.506974 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-046a5ef4-00fb-4576-86c3-1496442d6125 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:50.507665 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a5ef4-00fb-4576-86c3-1496442d6125 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:50.507998 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a5ef4-00fb-4576-86c3-1496442d6125 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:50.508311 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-046a5ef4-00fb-4576-86c3-1496442d6125 None admin] PATH_INFO: `/v3/projects/95765b05580b4ba6b95bab7fca7b6cd8` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:50.509612 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a5ef4-00fb-4576-86c3-1496442d6125 None admin] RBAC: Authorizing `identity:get_project(project_id=95765b05580b4ba6b95bab7fca7b6cd8)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:50.511226 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-046a5ef4-00fb-4576-86c3-1496442d6125 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:50.513185 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 598/1191] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:54:50 2022] GET /identity/v3/projects/95765b05580b4ba6b95bab7fca7b6cd8 => generated 361 bytes in 152 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:50.519639 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee163b-0898-4c04-99d1-89c280799970 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:50.585922 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:50.685415 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85ee163b-0898-4c04-99d1-89c280799970 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:50.745775 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb934d8e-35d8-4898-b3ea-9aab5343b27f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:50.746887 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb934d8e-35d8-4898-b3ea-9aab5343b27f None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:50.747364 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb934d8e-35d8-4898-b3ea-9aab5343b27f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:50.747829 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb934d8e-35d8-4898-b3ea-9aab5343b27f None admin] PATH_INFO: `/v3/projects/95765b05580b4ba6b95bab7fca7b6cd8/users/8f0ce32e4f9341ffbb5163a345184dee/roles/c73e9539582145ed8eedc48648b9d738` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:50.751644 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb934d8e-35d8-4898-b3ea-9aab5343b27f None admin] RBAC: Authorizing `identity:create_grant(project_id=95765b05580b4ba6b95bab7fca7b6cd8, user_id=8f0ce32e4f9341ffbb5163a345184dee, role_id=c73e9539582145ed8eedc48648b9d738)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:50.754459 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb934d8e-35d8-4898-b3ea-9aab5343b27f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:50.777524 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 594/1192] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 21 00:54:50 2022] PUT /identity/v3/projects/95765b05580b4ba6b95bab7fca7b6cd8/users/8f0ce32e4f9341ffbb5163a345184dee/roles/c73e9539582145ed8eedc48648b9d738 => generated 0 bytes in 258 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:54:53.130004 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b3acb-60a5-41be-bf9e-8d0e6a7bae39 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:53.130662 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b3acb-60a5-41be-bf9e-8d0e6a7bae39 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:53.130662 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-330b3acb-60a5-41be-bf9e-8d0e6a7bae39 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:53.131992 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 599/1193] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:54:53 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:54:53.138612 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716b796-9e82-40e2-9e3e-03e30359e95b None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:53.139314 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716b796-9e82-40e2-9e3e-03e30359e95b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:53.139314 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c716b796-9e82-40e2-9e3e-03e30359e95b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:53.160044 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-c716b796-9e82-40e2-9e3e-03e30359e95b None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:54:53.161412 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c716b796-9e82-40e2-9e3e-03e30359e95b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:54:53.241659 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 595/1194] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:54:53 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 104 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:54:53.526407 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b3acb-60a5-41be-bf9e-8d0e6a7bae39 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:53.650187 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-330b3acb-60a5-41be-bf9e-8d0e6a7bae39 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:53.671676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:53.692503 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a3845-3f58-40e0-a2eb-babcda13619e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:53.693537 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a3845-3f58-40e0-a2eb-babcda13619e None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:53.693993 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a3845-3f58-40e0-a2eb-babcda13619e None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:53.694350 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c75a3845-3f58-40e0-a2eb-babcda13619e None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:53.709871 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c75a3845-3f58-40e0-a2eb-babcda13619e None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:54:53.715122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-c75a3845-3f58-40e0-a2eb-babcda13619e None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:54:53.715122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:54:53.715122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:54:53.715122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:54:53.715122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:54:53.715122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:54:53.715122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:54:53.715122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:54:53.715122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:54:53.715122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:54:53.715122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:54:53.715122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:54:53.715122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:54:53.715122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:54:53.715122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:54:53.715122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:54:53.717133 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:54:53.717133 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:54:53.717133 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:54:53.717133 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:54:53.717133 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:54:53.717133 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:54:53.717133 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:54:53.717133 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:54:53.717133 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:54:53.717133 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:54:53.717133 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:54:53.717133 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:54:53.717133 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:54:53.717133 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:54:53.717133 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:54:53.717133 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:54:53.719013 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:54:53.719013 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:54:53.719013 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:54:53.719013 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:54:53.719013 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:54:53.719013 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:54:53.719013 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:54:53.719013 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:54:53.719013 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:54:53.719013 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:54:53.719013 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:54:53.719013 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:54:53.719013 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 600/1195] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:54:53 2022] GET /identity/v3/roles/admin => generated 83 bytes in 191 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:54:53.726796 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716b796-9e82-40e2-9e3e-03e30359e95b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:53.782470 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:53.909818 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c716b796-9e82-40e2-9e3e-03e30359e95b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:53.960481 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec35868-acf4-407e-88d0-c5e6140c0e45 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:53.961265 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec35868-acf4-407e-88d0-c5e6140c0e45 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:53.961624 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec35868-acf4-407e-88d0-c5e6140c0e45 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:53.961995 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dec35868-acf4-407e-88d0-c5e6140c0e45 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:53.962771 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec35868-acf4-407e-88d0-c5e6140c0e45 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:54:53.963188 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec35868-acf4-407e-88d0-c5e6140c0e45 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:53.964698 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dec35868-acf4-407e-88d0-c5e6140c0e45 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:53.975092 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 596/1196] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:54:53 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 250 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:53.985010 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a3845-3f58-40e0-a2eb-babcda13619e None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:54.152180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c75a3845-3f58-40e0-a2eb-babcda13619e None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:54.207446 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4871ae-9003-483e-8bb8-7bde862b1236 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:54.208428 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4871ae-9003-483e-8bb8-7bde862b1236 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:54.208891 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4871ae-9003-483e-8bb8-7bde862b1236 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:54.209410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f4871ae-9003-483e-8bb8-7bde862b1236 None admin] PATH_INFO: `/v3/users/8f0ce32e4f9341ffbb5163a345184dee` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:54.211473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4871ae-9003-483e-8bb8-7bde862b1236 None admin] RBAC: Authorizing `identity:get_user(user_id=8f0ce32e4f9341ffbb5163a345184dee)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:54.214110 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9f4871ae-9003-483e-8bb8-7bde862b1236 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:54.217149 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 601/1197] 10.222.0.49 () {56 vars in 1177 bytes} [Sun Aug 21 00:54:53 2022] GET /identity/v3/users/8f0ce32e4f9341ffbb5163a345184dee => generated 311 bytes in 233 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:54.226337 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec35868-acf4-407e-88d0-c5e6140c0e45 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:54.346272 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:54.356034 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dec35868-acf4-407e-88d0-c5e6140c0e45 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:54.397655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ed94a-737f-4c1f-9f7f-605df7362a44 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:54.398404 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ed94a-737f-4c1f-9f7f-605df7362a44 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:54.398763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ed94a-737f-4c1f-9f7f-605df7362a44 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:54.399120 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a1ed94a-737f-4c1f-9f7f-605df7362a44 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:54.492983 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ed94a-737f-4c1f-9f7f-605df7362a44 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:54.495760 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a1ed94a-737f-4c1f-9f7f-605df7362a44 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:54.624511 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:54.635207 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 597/1198] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:54:54 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 410 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:54:54.645454 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4871ae-9003-483e-8bb8-7bde862b1236 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:54.702174 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:54:54.764207 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f4871ae-9003-483e-8bb8-7bde862b1236 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:54.802357 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da606152-afc8-4be9-b34f-a290dff7d45f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:54.803076 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da606152-afc8-4be9-b34f-a290dff7d45f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:54.803393 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da606152-afc8-4be9-b34f-a290dff7d45f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:54.803707 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da606152-afc8-4be9-b34f-a290dff7d45f None admin] PATH_INFO: `/v3/projects/95765b05580b4ba6b95bab7fca7b6cd8` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:54.805033 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da606152-afc8-4be9-b34f-a290dff7d45f None admin] RBAC: Authorizing `identity:get_project(project_id=95765b05580b4ba6b95bab7fca7b6cd8)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:54.806623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da606152-afc8-4be9-b34f-a290dff7d45f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:54.808443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 602/1199] 10.222.0.49 () {56 vars in 1186 bytes} [Sun Aug 21 00:54:54 2022] GET /identity/v3/projects/95765b05580b4ba6b95bab7fca7b6cd8 => generated 361 bytes in 164 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:54:54.815045 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ed94a-737f-4c1f-9f7f-605df7362a44 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:54:54.981958 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a1ed94a-737f-4c1f-9f7f-605df7362a44 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:54:55.020826 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8a6e3879-d962-4d16-803c-554c01329a49 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:54:55.021428 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e3879-d962-4d16-803c-554c01329a49 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:54:55.021747 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e3879-d962-4d16-803c-554c01329a49 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:54:55.022059 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8a6e3879-d962-4d16-803c-554c01329a49 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:54:55.022834 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e3879-d962-4d16-803c-554c01329a49 None admin] RBAC: Adding query filter params (role.id=c73e9539582145ed8eedc48648b9d738, scope.project.id=95765b05580b4ba6b95bab7fca7b6cd8, user.id=8f0ce32e4f9341ffbb5163a345184dee) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:54:55.023181 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e3879-d962-4d16-803c-554c01329a49 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:54:55.024732 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8a6e3879-d962-4d16-803c-554c01329a49 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:54:55.031725 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 598/1200] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:54:54 2022] GET /identity/v3/role_assignments?user.id=8f0ce32e4f9341ffbb5163a345184dee&scope.project.id=95765b05580b4ba6b95bab7fca7b6cd8&role.id=c73e9539582145ed8eedc48648b9d738 => generated 608 bytes in 217 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:55:04.797743 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=43 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:55:05.028668 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=71 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:04.071107 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d5367-b3d1-436b-b8a0-ee194c98a0cc None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:04.071999 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d5367-b3d1-436b-b8a0-ee194c98a0cc None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:04.072170 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f2d5367-b3d1-436b-b8a0-ee194c98a0cc None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:04.074817 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 603/1201] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:56:04 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:56:04.084105 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f18ea-3958-4da4-8be7-cf8d3ea77b45 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:04.084733 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f18ea-3958-4da4-8be7-cf8d3ea77b45 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:04.085072 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-083f18ea-3958-4da4-8be7-cf8d3ea77b45 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:04.116481 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-083f18ea-3958-4da4-8be7-cf8d3ea77b45 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:04.118121 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-083f18ea-3958-4da4-8be7-cf8d3ea77b45 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:04.299885 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 599/1202] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:04 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 218 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:56:04.714989 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d5367-b3d1-436b-b8a0-ee194c98a0cc None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:04.976567 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9f2d5367-b3d1-436b-b8a0-ee194c98a0cc None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:05.056834 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb2a76-334e-460b-a9cb-14189a0bc619 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:05.058177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb2a76-334e-460b-a9cb-14189a0bc619 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:05.058645 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb2a76-334e-460b-a9cb-14189a0bc619 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:05.059098 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32bb2a76-334e-460b-a9cb-14189a0bc619 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:05.084029 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb2a76-334e-460b-a9cb-14189a0bc619 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:05.087220 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32bb2a76-334e-460b-a9cb-14189a0bc619 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:05.120661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-32bb2a76-334e-460b-a9cb-14189a0bc619 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:05.120661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:05.120661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:05.120661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:05.120661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:05.120661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:05.120661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:05.120661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:05.120661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:05.120661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:05.120661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:05.120661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:05.120661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:05.120661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:05.120661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:05.120661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:05.122976 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:05.122976 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:05.122976 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:05.122976 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:05.122976 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:05.122976 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:05.122976 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:05.122976 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:05.122976 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:05.122976 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:05.122976 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:05.122976 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:05.122976 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:05.122976 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:05.122976 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:05.122976 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:05.122976 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:05.124754 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:05.124754 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:05.124754 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:56:05.124754 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 604/1203] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:04 2022] GET /identity/v3/domains/Default => generated 87 bytes in 409 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:05.134048 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f18ea-3958-4da4-8be7-cf8d3ea77b45 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:05.390004 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-083f18ea-3958-4da4-8be7-cf8d3ea77b45 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:05.462737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:05.477602 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0cfa401e-6273-41bc-83f5-ec686676cfba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:05.478935 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa401e-6273-41bc-83f5-ec686676cfba None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:05.479718 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa401e-6273-41bc-83f5-ec686676cfba None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:05.480359 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0cfa401e-6273-41bc-83f5-ec686676cfba None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:05.482096 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa401e-6273-41bc-83f5-ec686676cfba None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:05.482706 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa401e-6273-41bc-83f5-ec686676cfba None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:05.485911 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0cfa401e-6273-41bc-83f5-ec686676cfba None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:05.526580 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 600/1204] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:05 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 394 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:05.536870 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb2a76-334e-460b-a9cb-14189a0bc619 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:05.691307 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:05.844812 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32bb2a76-334e-460b-a9cb-14189a0bc619 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:05.940049 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d218ecc-c82b-43a2-9a1e-ebecc1dba648 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:05.940870 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d218ecc-c82b-43a2-9a1e-ebecc1dba648 None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:05.941418 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d218ecc-c82b-43a2-9a1e-ebecc1dba648 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:05.942019 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d218ecc-c82b-43a2-9a1e-ebecc1dba648 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:05.942691 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d218ecc-c82b-43a2-9a1e-ebecc1dba648 None admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:05.949235 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d218ecc-c82b-43a2-9a1e-ebecc1dba648 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:05.999363 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 605/1205] 10.222.0.49 () {60 vars in 1132 bytes} [Sun Aug 21 00:56:05 2022] POST /identity/v3/users => generated 251 bytes in 463 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 00:56:09.672437 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab9ded-9345-430e-8fc5-88c0f6742992 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:09.673387 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab9ded-9345-430e-8fc5-88c0f6742992 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:09.673387 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d5ab9ded-9345-430e-8fc5-88c0f6742992 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:09.676229 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 601/1206] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:56:09 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:09.686454 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7c95c-c6d7-47c2-a7b9-4c7e23388a84 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:09.689158 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7c95c-c6d7-47c2-a7b9-4c7e23388a84 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:09.689158 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-30f7c95c-c6d7-47c2-a7b9-4c7e23388a84 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:09.721217 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-30f7c95c-c6d7-47c2-a7b9-4c7e23388a84 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:09.723272 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-30f7c95c-c6d7-47c2-a7b9-4c7e23388a84 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:09.884523 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 606/1207] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:09 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:56:10.464283 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab9ded-9345-430e-8fc5-88c0f6742992 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:10.711983 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d5ab9ded-9345-430e-8fc5-88c0f6742992 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:10.787557 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cceccab-7478-4a14-a8a9-a1263478afb5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:10.788642 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cceccab-7478-4a14-a8a9-a1263478afb5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:10.789362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cceccab-7478-4a14-a8a9-a1263478afb5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:10.789692 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1cceccab-7478-4a14-a8a9-a1263478afb5 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:10.813161 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1cceccab-7478-4a14-a8a9-a1263478afb5 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:10.825565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-1cceccab-7478-4a14-a8a9-a1263478afb5 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:10.825565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:10.825565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:10.825565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:10.825565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:10.825565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:10.825565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:10.825565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:10.825565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:10.825565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:10.825565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:10.825565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:10.825565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:10.825565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:10.825565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:10.825565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:10.828103 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:10.828103 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:10.828103 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:10.828103 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:10.828103 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:10.828103 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:10.828103 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:10.828103 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:10.828103 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:10.828103 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:10.828103 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:10.828103 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:10.828103 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:10.828103 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:10.828103 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:10.828103 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:10.830306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:10.830306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:10.830306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:10.830306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:10.830306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:10.830306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:10.830306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:10.830306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:10.830306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:10.830306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:10.830306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:10.830306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:56:10.830306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 602/1208] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 21 00:56:10 2022] GET /identity/v3/roles/service => generated 85 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:10.844288 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7c95c-c6d7-47c2-a7b9-4c7e23388a84 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:10.939084 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:11.079835 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-30f7c95c-c6d7-47c2-a7b9-4c7e23388a84 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:11.134179 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdec29f-5d8c-48d8-9046-54d352a471ce None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:11.135483 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdec29f-5d8c-48d8-9046-54d352a471ce None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:11.135925 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdec29f-5d8c-48d8-9046-54d352a471ce None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:11.136315 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dcdec29f-5d8c-48d8-9046-54d352a471ce None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:11.137241 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdec29f-5d8c-48d8-9046-54d352a471ce None admin] RBAC: Adding query filter params (name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:11.137628 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdec29f-5d8c-48d8-9046-54d352a471ce None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:11.139457 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dcdec29f-5d8c-48d8-9046-54d352a471ce None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:11.152714 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 607/1209] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 21 00:56:10 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 310 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:11.162590 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cceccab-7478-4a14-a8a9-a1263478afb5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:11.289394 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:11.431286 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1cceccab-7478-4a14-a8a9-a1263478afb5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:11.511113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f635df8-2731-4bf0-b9b3-e13925290527 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:11.512914 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f635df8-2731-4bf0-b9b3-e13925290527 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:11.513649 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f635df8-2731-4bf0-b9b3-e13925290527 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:11.514264 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f635df8-2731-4bf0-b9b3-e13925290527 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:11.540939 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f635df8-2731-4bf0-b9b3-e13925290527 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:11.544831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f635df8-2731-4bf0-b9b3-e13925290527 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:11.581754 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-5f635df8-2731-4bf0-b9b3-e13925290527 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:11.581754 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:11.581754 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:11.581754 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:11.581754 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:11.581754 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:11.581754 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:11.581754 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:11.581754 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:11.581754 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:11.581754 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:11.581754 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:11.581754 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:11.581754 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:11.581754 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:11.581754 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:11.583580 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:11.583580 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:11.583580 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:11.583580 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:11.583580 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:11.583580 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:11.583580 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:11.583580 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:11.583580 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:11.583580 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:11.583580 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:11.583580 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:11.583580 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:11.583580 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:11.583580 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:11.583580 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:11.583580 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:11.586043 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:11.586043 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:11.586043 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:56:11.586043 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 603/1210] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:11 2022] GET /identity/v3/domains/Default => generated 87 bytes in 423 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:11.594292 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdec29f-5d8c-48d8-9046-54d352a471ce None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:11.869411 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:11.874523 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dcdec29f-5d8c-48d8-9046-54d352a471ce None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:11.933295 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744bc2f4-2e80-4da1-b95b-6c41a9d1d3d8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:11.933973 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bc2f4-2e80-4da1-b95b-6c41a9d1d3d8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:11.934296 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bc2f4-2e80-4da1-b95b-6c41a9d1d3d8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:11.934561 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-744bc2f4-2e80-4da1-b95b-6c41a9d1d3d8 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:11.935181 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744bc2f4-2e80-4da1-b95b-6c41a9d1d3d8 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:11.935642 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744bc2f4-2e80-4da1-b95b-6c41a9d1d3d8 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:11.938266 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-744bc2f4-2e80-4da1-b95b-6c41a9d1d3d8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:11.957861 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 608/1211] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 365 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:11.965661 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f635df8-2731-4bf0-b9b3-e13925290527 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:12.164408 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f635df8-2731-4bf0-b9b3-e13925290527 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:12.167982 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:12.241869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4322b-900b-49d8-bbac-5c5175fbae83 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:12.243768 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4322b-900b-49d8-bbac-5c5175fbae83 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:12.244248 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4322b-900b-49d8-bbac-5c5175fbae83 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:12.244707 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53c4322b-900b-49d8-bbac-5c5175fbae83 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:12.261616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4322b-900b-49d8-bbac-5c5175fbae83 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:12.264603 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-53c4322b-900b-49d8-bbac-5c5175fbae83 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:12.285354 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-53c4322b-900b-49d8-bbac-5c5175fbae83 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:56:12.285354 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:12.285354 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:12.285354 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:12.285354 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:12.285354 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:12.285354 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:12.285354 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:12.285354 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:12.285354 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:12.285354 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:12.285354 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:12.285354 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:12.285354 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:12.285354 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:12.285354 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:12.287737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:12.287737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:12.287737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:12.287737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:12.287737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:12.287737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:12.287737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:12.287737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:12.287737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:12.287737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:12.287737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:12.287737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:12.287737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:12.287737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:12.287737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:12.287737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:12.287737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:12.287737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:12.290157 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:12.290157 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:12.290157 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:12.290157 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:12.290157 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:12.290157 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:12.290157 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:12.290157 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:12.290157 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:56:12.290157 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:56:12.290157 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 604/1212] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:11 2022] GET /identity/v3/users/placement => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:12.298726 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744bc2f4-2e80-4da1-b95b-6c41a9d1d3d8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:12.516053 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-744bc2f4-2e80-4da1-b95b-6c41a9d1d3d8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:12.590081 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be5a69-29bc-4e04-b1c7-317caa6fcb41 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:12.591336 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be5a69-29bc-4e04-b1c7-317caa6fcb41 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:12.591972 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be5a69-29bc-4e04-b1c7-317caa6fcb41 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:12.592444 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-77be5a69-29bc-4e04-b1c7-317caa6fcb41 None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:12.594224 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be5a69-29bc-4e04-b1c7-317caa6fcb41 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:12.594692 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be5a69-29bc-4e04-b1c7-317caa6fcb41 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:12.597713 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-77be5a69-29bc-4e04-b1c7-317caa6fcb41 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:12.645590 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 609/1213] 10.222.0.49 () {56 vars in 1143 bytes} [Sun Aug 21 00:56:12 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 342 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:12.653168 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4322b-900b-49d8-bbac-5c5175fbae83 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:12.872162 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-53c4322b-900b-49d8-bbac-5c5175fbae83 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:12.948056 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d1be5-301c-46d2-9f03-40238ff87ab7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:12.949262 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d1be5-301c-46d2-9f03-40238ff87ab7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:12.949762 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d1be5-301c-46d2-9f03-40238ff87ab7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:12.950251 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4a0d1be5-301c-46d2-9f03-40238ff87ab7 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:13.014237 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:13.069907 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d1be5-301c-46d2-9f03-40238ff87ab7 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:13.073296 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4a0d1be5-301c-46d2-9f03-40238ff87ab7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:13.321400 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 605/1214] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:12 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:56:13.328309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be5a69-29bc-4e04-b1c7-317caa6fcb41 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:13.372343 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:13.533085 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-77be5a69-29bc-4e04-b1c7-317caa6fcb41 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:13.603100 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425647ed-2999-4b94-8e9b-51941399f7a8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:13.604249 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425647ed-2999-4b94-8e9b-51941399f7a8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:13.604718 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425647ed-2999-4b94-8e9b-51941399f7a8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:13.605250 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-425647ed-2999-4b94-8e9b-51941399f7a8 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:13.626561 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425647ed-2999-4b94-8e9b-51941399f7a8 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:13.630575 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-425647ed-2999-4b94-8e9b-51941399f7a8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:13.663676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-425647ed-2999-4b94-8e9b-51941399f7a8 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:13.663676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:13.663676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:13.663676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:13.663676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:13.663676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:13.663676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:13.663676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:13.663676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:13.663676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:13.663676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:13.663676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:13.663676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:13.663676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:13.663676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:13.663676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:13.665358 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:13.665358 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:13.665358 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:13.665358 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:13.665358 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:13.665358 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:13.665358 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:13.665358 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:13.665358 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:13.665358 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:13.665358 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:13.665358 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:13.665358 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:13.665358 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:13.665358 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:13.665358 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:13.665358 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:13.667457 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:13.667457 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:13.667457 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:56:13.667457 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 610/1215] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:13 2022] GET /identity/v3/domains/Default => generated 87 bytes in 340 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:13.679113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d1be5-301c-46d2-9f03-40238ff87ab7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:13.848435 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:13.956813 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4a0d1be5-301c-46d2-9f03-40238ff87ab7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:14.028560 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d101e-0ac8-4d53-b833-b408b0560f46 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:14.029654 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d101e-0ac8-4d53-b833-b408b0560f46 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:14.030124 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d101e-0ac8-4d53-b833-b408b0560f46 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:14.030593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a9d101e-0ac8-4d53-b833-b408b0560f46 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:14.031690 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d101e-0ac8-4d53-b833-b408b0560f46 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:14.032029 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d101e-0ac8-4d53-b833-b408b0560f46 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:14.034728 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a9d101e-0ac8-4d53-b833-b408b0560f46 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:14.057956 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 606/1216] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:13 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 380 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:14.065532 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425647ed-2999-4b94-8e9b-51941399f7a8 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:14.205773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:14.272316 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-425647ed-2999-4b94-8e9b-51941399f7a8 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:14.360991 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5dac5e-92dc-471f-979a-a90fc3f5e78b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:14.362428 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dac5e-92dc-471f-979a-a90fc3f5e78b None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:14.362947 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dac5e-92dc-471f-979a-a90fc3f5e78b None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:14.363460 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dd5dac5e-92dc-471f-979a-a90fc3f5e78b None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:14.380668 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5dac5e-92dc-471f-979a-a90fc3f5e78b None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:14.383892 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dd5dac5e-92dc-471f-979a-a90fc3f5e78b None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:14.413023 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-dd5dac5e-92dc-471f-979a-a90fc3f5e78b None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:14.413023 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:14.413023 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:14.413023 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:14.413023 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:14.413023 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:14.413023 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:14.413023 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:14.413023 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:14.413023 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:14.413023 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:14.413023 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:14.413023 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:14.413023 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:14.413023 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:14.415481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:14.415481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:14.415481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:14.415481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:14.415481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:14.415481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:14.415481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:14.415481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:14.415481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:14.415481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:14.415481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:14.415481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:14.415481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:14.415481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:14.415481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:14.415481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:14.415481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:14.417698 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:14.417698 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:14.417698 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:14.417698 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:14.417698 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:14.417698 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:14.417698 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:14.417698 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:56:14.421662 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 611/1217] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:14 2022] GET /identity/v3/projects/service => generated 88 bytes in 357 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:14.431140 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d101e-0ac8-4d53-b833-b408b0560f46 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:14.651714 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a9d101e-0ac8-4d53-b833-b408b0560f46 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:14.692468 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:14.721596 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b09581a1-843d-4b1d-a526-1a96a23e1d03 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:14.722598 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09581a1-843d-4b1d-a526-1a96a23e1d03 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:14.722861 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09581a1-843d-4b1d-a526-1a96a23e1d03 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:14.723275 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b09581a1-843d-4b1d-a526-1a96a23e1d03 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:14.724279 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09581a1-843d-4b1d-a526-1a96a23e1d03 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:14.724793 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09581a1-843d-4b1d-a526-1a96a23e1d03 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:14.728097 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b09581a1-843d-4b1d-a526-1a96a23e1d03 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:14.751083 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 607/1218] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:14 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 322 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:14.760995 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5dac5e-92dc-471f-979a-a90fc3f5e78b None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:14.986919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dd5dac5e-92dc-471f-979a-a90fc3f5e78b None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:15.037496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:15.047807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55d5a457-0d0a-43f4-ab99-34917f19f013 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:15.048670 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5a457-0d0a-43f4-ab99-34917f19f013 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:15.049076 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5a457-0d0a-43f4-ab99-34917f19f013 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:15.049441 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55d5a457-0d0a-43f4-ab99-34917f19f013 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:15.050319 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5a457-0d0a-43f4-ab99-34917f19f013 None admin] RBAC: Adding query filter params (role.id=b549ba322af24099825f8949d2060adf, scope.project.id=838e996d09a0454b9bcdc5aef03ef203, user.id=3a225f81f16e4cf2a1e62bbb3ec8eee0) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:15.050869 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5a457-0d0a-43f4-ab99-34917f19f013 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:15.052982 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55d5a457-0d0a-43f4-ab99-34917f19f013 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:15.062083 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 612/1219] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:56:14 2022] GET /identity/v3/role_assignments?user.id=3a225f81f16e4cf2a1e62bbb3ec8eee0&scope.project.id=838e996d09a0454b9bcdc5aef03ef203&role.id=b549ba322af24099825f8949d2060adf => generated 259 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:18.034148 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7408a-58c3-4272-934d-12937d70c898 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:18.035032 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7408a-58c3-4272-934d-12937d70c898 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:18.035032 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-edd7408a-58c3-4272-934d-12937d70c898 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:18.037116 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 608/1220] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:56:18 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:18.046084 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e505a3-7746-461f-8d06-e45b9dc1c79d None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:18.046919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e505a3-7746-461f-8d06-e45b9dc1c79d None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:18.047255 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56e505a3-7746-461f-8d06-e45b9dc1c79d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:18.087089 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-56e505a3-7746-461f-8d06-e45b9dc1c79d None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:18.089511 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-56e505a3-7746-461f-8d06-e45b9dc1c79d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:18.231206 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 613/1221] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:18 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 184 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:56:18.546041 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7408a-58c3-4272-934d-12937d70c898 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:18.742374 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-edd7408a-58c3-4272-934d-12937d70c898 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:18.815850 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183fc58-e69f-43c2-958b-c1a661574484 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:18.816703 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183fc58-e69f-43c2-958b-c1a661574484 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:18.817197 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183fc58-e69f-43c2-958b-c1a661574484 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:18.817690 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d183fc58-e69f-43c2-958b-c1a661574484 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:18.839828 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d183fc58-e69f-43c2-958b-c1a661574484 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:18.846865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-d183fc58-e69f-43c2-958b-c1a661574484 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:18.846865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:18.846865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:18.846865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:18.846865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:18.846865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:18.846865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:18.846865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:18.846865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:18.846865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:18.846865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:18.846865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:18.846865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:18.846865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:18.846865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:18.846865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:18.849542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:18.849542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:18.849542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:18.849542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:18.849542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:18.849542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:18.849542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:18.849542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:18.849542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:18.849542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:18.849542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:18.849542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:18.849542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:18.849542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:18.849542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:18.849542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:18.851593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:18.851593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:18.851593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:18.851593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:18.851593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:18.851593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:18.851593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:18.851593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:18.851593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:18.851593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:18.851593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:18.851593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:56:18.851593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 609/1222] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 21 00:56:18 2022] GET /identity/v3/roles/service => generated 85 bytes in 303 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:18.859009 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e505a3-7746-461f-8d06-e45b9dc1c79d None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:19.066392 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56e505a3-7746-461f-8d06-e45b9dc1c79d None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:19.114962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:19.133818 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97684ece-7ce0-4917-8620-8d0afcc4d762 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:19.134797 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97684ece-7ce0-4917-8620-8d0afcc4d762 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:19.135061 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97684ece-7ce0-4917-8620-8d0afcc4d762 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:19.135467 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97684ece-7ce0-4917-8620-8d0afcc4d762 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:19.136211 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97684ece-7ce0-4917-8620-8d0afcc4d762 None admin] RBAC: Adding query filter params (name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:19.136534 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97684ece-7ce0-4917-8620-8d0afcc4d762 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:19.138015 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97684ece-7ce0-4917-8620-8d0afcc4d762 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:19.150149 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 614/1223] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 21 00:56:18 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:19.157653 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183fc58-e69f-43c2-958b-c1a661574484 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:19.245276 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:19.361413 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d183fc58-e69f-43c2-958b-c1a661574484 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:19.430065 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b05aa5-9ee9-415a-b164-7cb50cfa626c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:19.430869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b05aa5-9ee9-415a-b164-7cb50cfa626c None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:19.431209 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b05aa5-9ee9-415a-b164-7cb50cfa626c None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:19.431535 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9b05aa5-9ee9-415a-b164-7cb50cfa626c None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:19.446629 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b05aa5-9ee9-415a-b164-7cb50cfa626c None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:19.448456 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b9b05aa5-9ee9-415a-b164-7cb50cfa626c None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:19.471685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-b9b05aa5-9ee9-415a-b164-7cb50cfa626c None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:19.471685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:19.471685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:19.471685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:19.471685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:19.471685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:19.471685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:19.471685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:19.471685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:19.471685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:19.471685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:19.471685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:19.471685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:19.471685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:19.471685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:19.471685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:19.473680 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:19.473680 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:19.473680 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:19.473680 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:19.473680 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:19.473680 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:19.473680 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:19.473680 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:19.473680 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:19.473680 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:19.473680 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:19.473680 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:19.473680 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:19.473680 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:19.473680 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:19.473680 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:19.473680 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:19.475439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:19.475439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:19.475439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:56:19.475439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 610/1224] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:19 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:19.482797 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97684ece-7ce0-4917-8620-8d0afcc4d762 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:19.666514 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97684ece-7ce0-4917-8620-8d0afcc4d762 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:19.727956 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0f5da-4b6f-40d0-ac9b-fa8510e86f56 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:19.729215 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0f5da-4b6f-40d0-ac9b-fa8510e86f56 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:19.729769 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0f5da-4b6f-40d0-ac9b-fa8510e86f56 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:19.730259 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-45e0f5da-4b6f-40d0-ac9b-fa8510e86f56 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:19.731494 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e0f5da-4b6f-40d0-ac9b-fa8510e86f56 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:19.732048 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e0f5da-4b6f-40d0-ac9b-fa8510e86f56 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:19.734763 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-45e0f5da-4b6f-40d0-ac9b-fa8510e86f56 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:19.759760 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 615/1225] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:19 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 278 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:19.771001 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b05aa5-9ee9-415a-b164-7cb50cfa626c None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:19.966528 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:19.976601 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9b05aa5-9ee9-415a-b164-7cb50cfa626c None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:20.025295 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5beaf9-b360-4aa6-9646-ba68b1512ea9 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:20.026041 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5beaf9-b360-4aa6-9646-ba68b1512ea9 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:20.026514 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5beaf9-b360-4aa6-9646-ba68b1512ea9 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:20.026957 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e5beaf9-b360-4aa6-9646-ba68b1512ea9 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:20.041585 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5beaf9-b360-4aa6-9646-ba68b1512ea9 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:20.044513 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e5beaf9-b360-4aa6-9646-ba68b1512ea9 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:20.066145 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-7e5beaf9-b360-4aa6-9646-ba68b1512ea9 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:56:20.066145 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:20.066145 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:20.066145 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:20.066145 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:20.066145 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:20.066145 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:20.066145 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:20.066145 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:20.066145 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:20.066145 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:20.066145 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:20.066145 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:20.066145 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:20.066145 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:20.066145 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:20.068526 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:20.068526 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:20.068526 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:20.068526 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:20.068526 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:20.068526 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:20.068526 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:20.068526 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:20.068526 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:20.068526 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:20.068526 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:20.068526 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:20.068526 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:20.068526 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:20.068526 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:20.068526 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:20.068526 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:20.068526 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:20.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:20.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:20.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:20.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:20.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:20.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:20.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:20.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:20.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:56:20.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:56:20.070562 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 611/1226] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:19 2022] GET /identity/v3/users/placement => generated 87 bytes in 299 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:20.077617 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0f5da-4b6f-40d0-ac9b-fa8510e86f56 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:20.166563 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:20.264839 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-45e0f5da-4b6f-40d0-ac9b-fa8510e86f56 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:20.319843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f01da-39ba-4b89-ac5b-6f4f7a4e7ccb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:20.320873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f01da-39ba-4b89-ac5b-6f4f7a4e7ccb None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:20.321385 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f01da-39ba-4b89-ac5b-6f4f7a4e7ccb None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:20.321857 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f60f01da-39ba-4b89-ac5b-6f4f7a4e7ccb None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:20.323094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f01da-39ba-4b89-ac5b-6f4f7a4e7ccb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:20.323530 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f01da-39ba-4b89-ac5b-6f4f7a4e7ccb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:20.325297 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f60f01da-39ba-4b89-ac5b-6f4f7a4e7ccb None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:20.350572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 616/1227] 10.222.0.49 () {56 vars in 1143 bytes} [Sun Aug 21 00:56:20 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 274 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:20.357180 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5beaf9-b360-4aa6-9646-ba68b1512ea9 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:20.535860 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e5beaf9-b360-4aa6-9646-ba68b1512ea9 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:20.595733 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720a8c0-b8b5-4be9-8a32-f2da8e68d738 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:20.596811 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720a8c0-b8b5-4be9-8a32-f2da8e68d738 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:20.597307 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720a8c0-b8b5-4be9-8a32-f2da8e68d738 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:20.597804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9720a8c0-b8b5-4be9-8a32-f2da8e68d738 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:20.618052 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720a8c0-b8b5-4be9-8a32-f2da8e68d738 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:20.620591 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9720a8c0-b8b5-4be9-8a32-f2da8e68d738 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:20.648739 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-9720a8c0-b8b5-4be9-8a32-f2da8e68d738 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:20.648739 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:20.648739 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:20.648739 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:20.648739 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:20.648739 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:20.648739 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:20.648739 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:20.648739 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:20.648739 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:20.648739 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:20.648739 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:20.648739 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:20.648739 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:20.648739 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:20.648739 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:20.650641 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:20.650641 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:20.650641 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:20.650641 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:20.650641 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:20.650641 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:20.650641 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:20.650641 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:20.650641 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:20.650641 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:20.650641 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:20.650641 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:20.650641 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:20.650641 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:20.650641 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:20.650641 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:20.650641 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:20.652500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:20.652500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:20.652500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:56:20.652500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 612/1228] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:20 2022] GET /identity/v3/domains/Default => generated 87 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:20.660565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f01da-39ba-4b89-ac5b-6f4f7a4e7ccb None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:20.881733 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f60f01da-39ba-4b89-ac5b-6f4f7a4e7ccb None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:20.886514 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:20.945908 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14016a1d-5882-4051-b146-5402e8eb5681 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:20.946971 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14016a1d-5882-4051-b146-5402e8eb5681 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:20.947578 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14016a1d-5882-4051-b146-5402e8eb5681 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:20.948091 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-14016a1d-5882-4051-b146-5402e8eb5681 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:20.949536 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14016a1d-5882-4051-b146-5402e8eb5681 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:20.950108 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14016a1d-5882-4051-b146-5402e8eb5681 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:20.953279 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-14016a1d-5882-4051-b146-5402e8eb5681 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:20.974843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 617/1229] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:20 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 317 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:20.984764 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720a8c0-b8b5-4be9-8a32-f2da8e68d738 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:21.004634 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:21.206536 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9720a8c0-b8b5-4be9-8a32-f2da8e68d738 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:21.277067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a250c-fc10-4300-a5c9-f49c71249189 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:21.278016 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a250c-fc10-4300-a5c9-f49c71249189 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:21.279028 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a250c-fc10-4300-a5c9-f49c71249189 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:21.279437 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ce4a250c-fc10-4300-a5c9-f49c71249189 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:21.289730 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a250c-fc10-4300-a5c9-f49c71249189 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:21.291627 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ce4a250c-fc10-4300-a5c9-f49c71249189 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:21.311038 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-ce4a250c-fc10-4300-a5c9-f49c71249189 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:21.311038 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:21.311038 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:21.311038 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:21.311038 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:21.311038 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:21.311038 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:21.311038 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:21.311038 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:21.311038 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:21.311038 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:21.311038 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:21.311038 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:21.311038 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:21.311038 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:21.323475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:21.323475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:21.323475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:21.323475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:21.323475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:21.323475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:21.323475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:21.323475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:21.323475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:21.323475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:21.323475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:21.323475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:21.323475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:21.323475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:21.323475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:21.323475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:21.323475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:21.326703 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:21.326703 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:21.326703 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:21.326703 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:21.326703 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:21.326703 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:21.326703 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:21.326703 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:56:21.326703 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 613/1230] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:20 2022] GET /identity/v3/projects/service => generated 88 bytes in 329 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:56:21.328068 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14016a1d-5882-4051-b146-5402e8eb5681 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:21.503749 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-14016a1d-5882-4051-b146-5402e8eb5681 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:21.566578 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fcaf6ba2-e41c-4ac8-9b6a-149da5c786f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:21.567591 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf6ba2-e41c-4ac8-9b6a-149da5c786f4 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:21.567976 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf6ba2-e41c-4ac8-9b6a-149da5c786f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:21.568341 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fcaf6ba2-e41c-4ac8-9b6a-149da5c786f4 None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:21.569288 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf6ba2-e41c-4ac8-9b6a-149da5c786f4 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:21.569850 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf6ba2-e41c-4ac8-9b6a-149da5c786f4 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:21.572501 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fcaf6ba2-e41c-4ac8-9b6a-149da5c786f4 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:21.598962 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 618/1231] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:21 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 276 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:21.608428 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a250c-fc10-4300-a5c9-f49c71249189 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:21.727379 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:21.807559 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ce4a250c-fc10-4300-a5c9-f49c71249189 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:21.869222 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0d866b4-3e5d-43fd-95f2-52699f5e9e19 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:21.870501 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d866b4-3e5d-43fd-95f2-52699f5e9e19 None admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:21.870813 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d866b4-3e5d-43fd-95f2-52699f5e9e19 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:21.871368 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0d866b4-3e5d-43fd-95f2-52699f5e9e19 None admin] PATH_INFO: `/v3/projects/838e996d09a0454b9bcdc5aef03ef203/users/3a225f81f16e4cf2a1e62bbb3ec8eee0/roles/b549ba322af24099825f8949d2060adf` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:21.898950 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d866b4-3e5d-43fd-95f2-52699f5e9e19 None admin] RBAC: Authorizing `identity:create_grant(project_id=838e996d09a0454b9bcdc5aef03ef203, user_id=3a225f81f16e4cf2a1e62bbb3ec8eee0, role_id=b549ba322af24099825f8949d2060adf)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:21.900566 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0d866b4-3e5d-43fd-95f2-52699f5e9e19 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:21.920457 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 614/1232] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 21 00:56:21 2022] PUT /identity/v3/projects/838e996d09a0454b9bcdc5aef03ef203/users/3a225f81f16e4cf2a1e62bbb3ec8eee0/roles/b549ba322af24099825f8949d2060adf => generated 0 bytes in 313 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:56:24.478032 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f86cf-7670-4be1-b995-2f79139df08c None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:24.478789 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f86cf-7670-4be1-b995-2f79139df08c None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:24.478789 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-726f86cf-7670-4be1-b995-2f79139df08c None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:24.480230 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 619/1233] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:56:24 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:56:24.486655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6396b-2a4c-463f-8bd9-c275216f66b9 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:24.487335 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6396b-2a4c-463f-8bd9-c275216f66b9 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:24.487335 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eea6396b-2a4c-463f-8bd9-c275216f66b9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:24.509814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-eea6396b-2a4c-463f-8bd9-c275216f66b9 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:24.511822 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-eea6396b-2a4c-463f-8bd9-c275216f66b9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:24.612707 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 615/1234] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:24 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 127 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:56:24.973273 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f86cf-7670-4be1-b995-2f79139df08c None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:25.019268 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:25.159712 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-726f86cf-7670-4be1-b995-2f79139df08c None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:25.217355 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac57b9-d434-407e-8b1c-c7a32335c4c3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:25.218225 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac57b9-d434-407e-8b1c-c7a32335c4c3 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:25.218422 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac57b9-d434-407e-8b1c-c7a32335c4c3 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:25.218762 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7cac57b9-d434-407e-8b1c-c7a32335c4c3 None admin] PATH_INFO: `/v3/roles/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:25.236317 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7cac57b9-d434-407e-8b1c-c7a32335c4c3 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:25.243130 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-7cac57b9-d434-407e-8b1c-c7a32335c4c3 None admin] Could not find role: service.: keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:25.243130 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:25.243130 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:25.243130 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:25.243130 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:25.243130 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:25.243130 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:25.243130 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:25.243130 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:25.243130 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:25.243130 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:25.243130 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:25.243130 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:25.243130 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:25.243130 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:25.243130 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:25.245217 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:25.245217 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:25.245217 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:25.245217 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:25.245217 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:25.245217 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:25.245217 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:25.245217 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:25.245217 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:25.245217 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:25.245217 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:25.245217 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:25.245217 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:25.245217 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:25.245217 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:25.245217 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:25.246744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:25.246744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:25.246744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:25.246744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:25.246744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:25.246744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:25.246744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:25.246744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:25.246744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:25.246744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:25.246744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: service. Aug 21 00:56:25.246744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:56:25.246744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 620/1235] 10.222.0.49 () {56 vars in 1102 bytes} [Sun Aug 21 00:56:24 2022] GET /identity/v3/roles/service => generated 85 bytes in 273 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:56:25.255859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6396b-2a4c-463f-8bd9-c275216f66b9 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:25.351083 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:25.468152 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eea6396b-2a4c-463f-8bd9-c275216f66b9 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:25.533178 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cf101-2e29-4c2b-bd2c-1fd96818b2f5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:25.534264 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cf101-2e29-4c2b-bd2c-1fd96818b2f5 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:25.534584 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cf101-2e29-4c2b-bd2c-1fd96818b2f5 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:25.535059 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d40cf101-2e29-4c2b-bd2c-1fd96818b2f5 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:25.536381 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40cf101-2e29-4c2b-bd2c-1fd96818b2f5 None admin] RBAC: Adding query filter params (name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:25.537015 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40cf101-2e29-4c2b-bd2c-1fd96818b2f5 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:25.539990 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d40cf101-2e29-4c2b-bd2c-1fd96818b2f5 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:25.556775 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 616/1236] 10.222.0.49 () {56 vars in 1103 bytes} [Sun Aug 21 00:56:25 2022] GET /identity/v3/roles?name=service => generated 326 bytes in 302 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:25.567805 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac57b9-d434-407e-8b1c-c7a32335c4c3 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:25.747121 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:25.777556 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7cac57b9-d434-407e-8b1c-c7a32335c4c3 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:25.869808 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b49c16-09e2-44b0-ae9e-f1d042181ed6 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:25.871315 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b49c16-09e2-44b0-ae9e-f1d042181ed6 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:25.872021 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b49c16-09e2-44b0-ae9e-f1d042181ed6 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:25.872720 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00b49c16-09e2-44b0-ae9e-f1d042181ed6 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:25.895059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b49c16-09e2-44b0-ae9e-f1d042181ed6 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:25.898178 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00b49c16-09e2-44b0-ae9e-f1d042181ed6 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:25.928879 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-00b49c16-09e2-44b0-ae9e-f1d042181ed6 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:25.928879 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:25.928879 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:25.928879 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:25.928879 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:25.928879 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:25.928879 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:25.928879 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:25.928879 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:25.928879 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:25.928879 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:25.928879 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:25.928879 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:25.928879 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:25.928879 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:25.928879 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:25.931077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:25.931077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:25.931077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:25.931077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:25.931077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:25.931077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:25.931077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:25.931077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:25.931077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:25.931077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:25.931077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:25.931077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:25.931077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:25.931077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:25.931077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:25.931077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:25.931077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:25.932921 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:25.932921 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:25.932921 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:56:25.932921 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 621/1237] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:25 2022] GET /identity/v3/domains/Default => generated 87 bytes in 365 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:25.943338 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cf101-2e29-4c2b-bd2c-1fd96818b2f5 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:26.132197 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d40cf101-2e29-4c2b-bd2c-1fd96818b2f5 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:26.152010 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:26.203547 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d929894-05e9-4bb6-9f93-65a883bafd26 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:26.204549 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d929894-05e9-4bb6-9f93-65a883bafd26 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:26.204997 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d929894-05e9-4bb6-9f93-65a883bafd26 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:26.205514 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d929894-05e9-4bb6-9f93-65a883bafd26 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:26.206682 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d929894-05e9-4bb6-9f93-65a883bafd26 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:26.207195 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d929894-05e9-4bb6-9f93-65a883bafd26 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:26.209749 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d929894-05e9-4bb6-9f93-65a883bafd26 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:26.235635 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 617/1238] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:25 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 293 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:26.241505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b49c16-09e2-44b0-ae9e-f1d042181ed6 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:26.436814 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00b49c16-09e2-44b0-ae9e-f1d042181ed6 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:26.506752 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f8ddd-88a8-4bc0-9806-3762be87c170 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:26.507503 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f8ddd-88a8-4bc0-9806-3762be87c170 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:26.507867 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f8ddd-88a8-4bc0-9806-3762be87c170 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:26.508199 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0b0f8ddd-88a8-4bc0-9806-3762be87c170 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:26.512663 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:26.522003 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f8ddd-88a8-4bc0-9806-3762be87c170 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:26.524240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0b0f8ddd-88a8-4bc0-9806-3762be87c170 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:26.547861 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-0b0f8ddd-88a8-4bc0-9806-3762be87c170 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:56:26.547861 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:26.547861 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:26.547861 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:26.547861 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:26.547861 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:26.547861 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:26.547861 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:26.547861 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:26.547861 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:26.547861 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:26.547861 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:26.547861 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:26.547861 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:26.547861 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:26.547861 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:26.550128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:26.550128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:26.550128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:26.550128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:26.550128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:26.550128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:26.550128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:26.550128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:26.550128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:26.550128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:26.550128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:26.550128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:26.550128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:26.550128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:26.550128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:26.550128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:26.550128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:26.550128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:26.552097 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:26.552097 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:26.552097 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:26.552097 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:26.552097 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:26.552097 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:26.552097 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:26.552097 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:26.552097 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:56:26.552097 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:56:26.552097 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 622/1239] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:26 2022] GET /identity/v3/users/placement => generated 87 bytes in 310 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:56:26.560479 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d929894-05e9-4bb6-9f93-65a883bafd26 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:26.752032 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d929894-05e9-4bb6-9f93-65a883bafd26 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:26.809340 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52537391-376a-4877-9837-2a1a59aaf104 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:26.810239 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52537391-376a-4877-9837-2a1a59aaf104 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:26.810744 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52537391-376a-4877-9837-2a1a59aaf104 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:26.811103 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-52537391-376a-4877-9837-2a1a59aaf104 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:26.812290 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52537391-376a-4877-9837-2a1a59aaf104 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:26.812730 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52537391-376a-4877-9837-2a1a59aaf104 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:26.814933 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-52537391-376a-4877-9837-2a1a59aaf104 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:26.848429 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 618/1240] 10.222.0.49 () {56 vars in 1143 bytes} [Sun Aug 21 00:56:26 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 289 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:26.857841 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f8ddd-88a8-4bc0-9806-3762be87c170 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:27.040501 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0b0f8ddd-88a8-4bc0-9806-3762be87c170 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:27.107493 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0d4d4-6e02-4dd1-bf93-a0bf5cb2681c None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:27.108888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0d4d4-6e02-4dd1-bf93-a0bf5cb2681c None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:27.109510 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0d4d4-6e02-4dd1-bf93-a0bf5cb2681c None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:27.110140 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42b0d4d4-6e02-4dd1-bf93-a0bf5cb2681c None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:27.235621 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:27.248454 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0d4d4-6e02-4dd1-bf93-a0bf5cb2681c None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:27.250788 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42b0d4d4-6e02-4dd1-bf93-a0bf5cb2681c None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:27.454457 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 623/1241] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:26 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 598 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:56:27.464882 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52537391-376a-4877-9837-2a1a59aaf104 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:27.521561 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:27.674509 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-52537391-376a-4877-9837-2a1a59aaf104 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:27.730669 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505c5ad-86c6-47fd-b44d-ab8a1fa22fa7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:27.731328 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505c5ad-86c6-47fd-b44d-ab8a1fa22fa7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:27.731646 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505c5ad-86c6-47fd-b44d-ab8a1fa22fa7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:27.732043 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f505c5ad-86c6-47fd-b44d-ab8a1fa22fa7 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:27.755214 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505c5ad-86c6-47fd-b44d-ab8a1fa22fa7 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:27.757265 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f505c5ad-86c6-47fd-b44d-ab8a1fa22fa7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:27.779068 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-f505c5ad-86c6-47fd-b44d-ab8a1fa22fa7 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:27.779068 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:27.779068 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:27.779068 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:27.779068 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:27.779068 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:27.779068 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:27.779068 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:27.779068 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:27.779068 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:27.779068 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:27.779068 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:27.779068 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:27.779068 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:27.779068 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:27.779068 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:27.786581 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:27.786581 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:27.786581 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:27.786581 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:27.786581 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:27.786581 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:27.786581 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:27.786581 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:27.786581 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:27.786581 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:27.786581 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:27.786581 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:27.786581 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:27.786581 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:27.786581 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:27.786581 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:27.786581 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:27.787663 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:27.787663 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:27.787663 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:56:27.787663 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 619/1242] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:27 2022] GET /identity/v3/domains/Default => generated 87 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:27.789629 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0d4d4-6e02-4dd1-bf93-a0bf5cb2681c None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:27.988581 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:27.997666 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42b0d4d4-6e02-4dd1-bf93-a0bf5cb2681c None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:28.071827 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290b3b8-649f-4b3c-a6df-4f6f7c441379 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:28.072610 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290b3b8-649f-4b3c-a6df-4f6f7c441379 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:28.072910 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290b3b8-649f-4b3c-a6df-4f6f7c441379 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:28.074782 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d290b3b8-649f-4b3c-a6df-4f6f7c441379 None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:28.074782 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290b3b8-649f-4b3c-a6df-4f6f7c441379 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:28.074782 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290b3b8-649f-4b3c-a6df-4f6f7c441379 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:28.076101 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d290b3b8-649f-4b3c-a6df-4f6f7c441379 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:28.095429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 624/1243] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:27 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 308 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:28.103298 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505c5ad-86c6-47fd-b44d-ab8a1fa22fa7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:28.246462 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:28.291399 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f505c5ad-86c6-47fd-b44d-ab8a1fa22fa7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:28.358542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c75e2f-eb30-4188-9fc0-7dd811b881b8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:28.359827 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c75e2f-eb30-4188-9fc0-7dd811b881b8 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:28.360549 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c75e2f-eb30-4188-9fc0-7dd811b881b8 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:28.361191 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6c75e2f-eb30-4188-9fc0-7dd811b881b8 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:28.380898 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c75e2f-eb30-4188-9fc0-7dd811b881b8 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:28.382499 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c6c75e2f-eb30-4188-9fc0-7dd811b881b8 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:28.399931 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-c6c75e2f-eb30-4188-9fc0-7dd811b881b8 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:28.399931 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:28.399931 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:28.399931 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:28.399931 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:28.399931 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:28.399931 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:28.399931 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:28.399931 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:28.399931 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:28.399931 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:28.399931 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:28.399931 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:28.399931 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:28.399931 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:28.402565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:28.402565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:28.402565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:28.402565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:28.402565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:28.402565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:28.402565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:28.402565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:28.402565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:28.402565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:28.402565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:28.402565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:28.402565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:28.402565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:28.402565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:28.402565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:28.402565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:28.403771 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:28.403771 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:28.403771 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:28.403771 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:28.403771 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:28.403771 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:28.403771 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:28.403771 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:56:28.403771 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 620/1244] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:28 2022] GET /identity/v3/projects/service => generated 88 bytes in 301 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:56:28.410736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290b3b8-649f-4b3c-a6df-4f6f7c441379 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:28.599516 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d290b3b8-649f-4b3c-a6df-4f6f7c441379 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:28.665978 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-030858da-3afc-42b5-85b0-f3279972e5e1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:28.666800 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030858da-3afc-42b5-85b0-f3279972e5e1 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:28.667277 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030858da-3afc-42b5-85b0-f3279972e5e1 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:28.667662 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-030858da-3afc-42b5-85b0-f3279972e5e1 None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:28.668461 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030858da-3afc-42b5-85b0-f3279972e5e1 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:28.668928 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030858da-3afc-42b5-85b0-f3279972e5e1 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:28.671353 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-030858da-3afc-42b5-85b0-f3279972e5e1 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:28.692406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 625/1245] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:28 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 283 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:28.702066 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c75e2f-eb30-4188-9fc0-7dd811b881b8 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:28.903748 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6c75e2f-eb30-4188-9fc0-7dd811b881b8 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:28.970088 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85dfb2b4-eeb2-4ce3-a4cb-be0b04a38ab3 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:28.971242 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfb2b4-eeb2-4ce3-a4cb-be0b04a38ab3 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:28.971729 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfb2b4-eeb2-4ce3-a4cb-be0b04a38ab3 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:28.972169 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85dfb2b4-eeb2-4ce3-a4cb-be0b04a38ab3 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:28.973553 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfb2b4-eeb2-4ce3-a4cb-be0b04a38ab3 None admin] RBAC: Adding query filter params (role.id=b549ba322af24099825f8949d2060adf, scope.project.id=838e996d09a0454b9bcdc5aef03ef203, user.id=3a225f81f16e4cf2a1e62bbb3ec8eee0) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:28.973872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfb2b4-eeb2-4ce3-a4cb-be0b04a38ab3 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:28.976128 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-85dfb2b4-eeb2-4ce3-a4cb-be0b04a38ab3 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:28.988511 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 621/1246] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:56:28 2022] GET /identity/v3/role_assignments?user.id=3a225f81f16e4cf2a1e62bbb3ec8eee0&scope.project.id=838e996d09a0454b9bcdc5aef03ef203&role.id=b549ba322af24099825f8949d2060adf => generated 608 bytes in 287 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:31.863930 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c481e9c-06e6-4cda-bce9-6718c65a65b6 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:31.864783 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c481e9c-06e6-4cda-bce9-6718c65a65b6 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:31.865036 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c481e9c-06e6-4cda-bce9-6718c65a65b6 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:31.868392 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 626/1247] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:56:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:31.878889 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77d592-c26e-4d0b-8b21-10022f5b837c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:31.879628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77d592-c26e-4d0b-8b21-10022f5b837c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:31.879877 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c77d592-c26e-4d0b-8b21-10022f5b837c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:31.890643 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:31.918264 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-8c77d592-c26e-4d0b-8b21-10022f5b837c None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:31.920814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8c77d592-c26e-4d0b-8b21-10022f5b837c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:32.066141 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 622/1248] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:31 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:56:32.583792 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c481e9c-06e6-4cda-bce9-6718c65a65b6 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:32.624367 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:32.787352 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c481e9c-06e6-4cda-bce9-6718c65a65b6 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:32.845653 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d6d46-5471-4218-90b7-7e0ff55983f4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:32.846577 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d6d46-5471-4218-90b7-7e0ff55983f4 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:32.847060 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d6d46-5471-4218-90b7-7e0ff55983f4 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:32.847519 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e75d6d46-5471-4218-90b7-7e0ff55983f4 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:32.866929 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e75d6d46-5471-4218-90b7-7e0ff55983f4 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:32.874934 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-e75d6d46-5471-4218-90b7-7e0ff55983f4 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:56:32.874934 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:32.874934 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:32.874934 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:32.874934 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:32.874934 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:32.874934 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:32.874934 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:32.874934 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:32.874934 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:32.874934 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:32.874934 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:32.874934 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:32.874934 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:32.874934 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:32.874934 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:32.878398 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:32.878398 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:32.878398 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:32.878398 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:32.878398 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:32.878398 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:32.878398 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:32.878398 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:32.878398 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:32.878398 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:32.878398 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:32.878398 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:32.878398 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:32.878398 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:32.878398 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:32.878398 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:32.880342 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:32.880342 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:32.880342 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:32.880342 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:32.880342 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:32.880342 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:32.880342 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:32.880342 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:32.880342 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:32.880342 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:32.880342 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:56:32.880342 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:56:32.880342 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 627/1249] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:56:32 2022] GET /identity/v3/roles/admin => generated 83 bytes in 295 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:32.885378 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77d592-c26e-4d0b-8b21-10022f5b837c None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:33.077243 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c77d592-c26e-4d0b-8b21-10022f5b837c None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:33.125465 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:33.133215 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ff1e2-b706-45c2-97cc-ff572d32b7ec None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:33.134303 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ff1e2-b706-45c2-97cc-ff572d32b7ec None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:33.134755 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ff1e2-b706-45c2-97cc-ff572d32b7ec None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:33.135099 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9b8ff1e2-b706-45c2-97cc-ff572d32b7ec None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:33.135999 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ff1e2-b706-45c2-97cc-ff572d32b7ec None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:33.136385 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ff1e2-b706-45c2-97cc-ff572d32b7ec None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:33.138606 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9b8ff1e2-b706-45c2-97cc-ff572d32b7ec None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:33.152018 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 623/1250] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:56:32 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 268 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:33.160748 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d6d46-5471-4218-90b7-7e0ff55983f4 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:33.289027 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:33.326955 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e75d6d46-5471-4218-90b7-7e0ff55983f4 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:33.399682 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca618d-b583-4266-a2ea-f1fc9dcd267f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:33.400244 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca618d-b583-4266-a2ea-f1fc9dcd267f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:33.400516 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca618d-b583-4266-a2ea-f1fc9dcd267f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:33.400803 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ddca618d-b583-4266-a2ea-f1fc9dcd267f None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:33.424729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca618d-b583-4266-a2ea-f1fc9dcd267f None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:33.427781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ddca618d-b583-4266-a2ea-f1fc9dcd267f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:33.463513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-ddca618d-b583-4266-a2ea-f1fc9dcd267f None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:33.463513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:33.463513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:33.463513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:33.463513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:33.463513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:33.463513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:33.463513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:33.463513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:33.463513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:33.463513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:33.463513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:33.463513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:33.463513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:33.463513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:33.463513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:33.465544 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:33.465544 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:33.465544 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:33.465544 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:33.465544 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:33.465544 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:33.465544 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:33.465544 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:33.465544 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:33.465544 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:33.465544 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:33.465544 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:33.465544 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:33.465544 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:33.465544 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:33.465544 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:33.465544 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:33.467321 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:33.467321 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:33.467321 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:56:33.467321 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 628/1251] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:33 2022] GET /identity/v3/domains/Default => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:56:33.472540 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ff1e2-b706-45c2-97cc-ff572d32b7ec None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:33.660862 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9b8ff1e2-b706-45c2-97cc-ff572d32b7ec None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:33.721829 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76569859-0a75-4933-b300-82e342ff87c7 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:33.723001 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76569859-0a75-4933-b300-82e342ff87c7 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:33.723374 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76569859-0a75-4933-b300-82e342ff87c7 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:33.723678 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76569859-0a75-4933-b300-82e342ff87c7 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:33.724507 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76569859-0a75-4933-b300-82e342ff87c7 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:33.724919 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76569859-0a75-4933-b300-82e342ff87c7 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:33.726608 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-76569859-0a75-4933-b300-82e342ff87c7 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:33.753644 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 624/1252] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:33 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 282 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:33.762099 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca618d-b583-4266-a2ea-f1fc9dcd267f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:33.957418 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ddca618d-b583-4266-a2ea-f1fc9dcd267f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:34.007584 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:34.023581 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee8b02-da70-4a6c-8082-439b1db25e2f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:34.024704 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee8b02-da70-4a6c-8082-439b1db25e2f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:34.025245 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee8b02-da70-4a6c-8082-439b1db25e2f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:34.025722 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-44ee8b02-da70-4a6c-8082-439b1db25e2f None admin] PATH_INFO: `/v3/users/placement` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:34.042424 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee8b02-da70-4a6c-8082-439b1db25e2f None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:34.045298 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-44ee8b02-da70-4a6c-8082-439b1db25e2f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:34.064813 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-44ee8b02-da70-4a6c-8082-439b1db25e2f None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:56:34.064813 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:34.064813 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:34.064813 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:34.064813 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:34.064813 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:34.064813 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:34.064813 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:34.064813 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:34.064813 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:34.064813 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:34.064813 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:34.064813 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:34.064813 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:34.064813 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:34.064813 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:34.067141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:34.067141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:34.067141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:34.067141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:34.067141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:34.067141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:34.067141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:34.067141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:34.067141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:34.067141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:34.067141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:34.067141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:34.067141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:34.067141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:34.067141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:34.067141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:34.067141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:34.067141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:34.069248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:34.069248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:34.069248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:34.069248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:34.069248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:34.069248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:34.069248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:34.069248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:34.069248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:56:34.069248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:56:34.069248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 629/1253] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:33 2022] GET /identity/v3/users/placement => generated 87 bytes in 306 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:34.078562 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76569859-0a75-4933-b300-82e342ff87c7 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:34.165099 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:34.243739 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-76569859-0a75-4933-b300-82e342ff87c7 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:34.320595 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f86c86-ed40-46be-9aa3-1a31d0ff38cb None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:34.321831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f86c86-ed40-46be-9aa3-1a31d0ff38cb None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:34.322586 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f86c86-ed40-46be-9aa3-1a31d0ff38cb None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:34.323181 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-38f86c86-ed40-46be-9aa3-1a31d0ff38cb None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:34.324730 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f86c86-ed40-46be-9aa3-1a31d0ff38cb None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:34.325327 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f86c86-ed40-46be-9aa3-1a31d0ff38cb None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:34.328259 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-38f86c86-ed40-46be-9aa3-1a31d0ff38cb None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:34.374201 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 625/1254] 10.222.0.49 () {56 vars in 1143 bytes} [Sun Aug 21 00:56:34 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 301 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:34.386488 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee8b02-da70-4a6c-8082-439b1db25e2f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:34.614782 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-44ee8b02-da70-4a6c-8082-439b1db25e2f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:34.684904 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cc75e-206a-49a9-8677-42a9684dffe1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:34.686357 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cc75e-206a-49a9-8677-42a9684dffe1 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:34.687059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cc75e-206a-49a9-8677-42a9684dffe1 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:34.687920 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-594cc75e-206a-49a9-8677-42a9684dffe1 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:34.808819 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:34.833515 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594cc75e-206a-49a9-8677-42a9684dffe1 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:34.836419 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-594cc75e-206a-49a9-8677-42a9684dffe1 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:35.019680 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 630/1255] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:34 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 634 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:56:35.034385 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f86c86-ed40-46be-9aa3-1a31d0ff38cb None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:35.209770 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-38f86c86-ed40-46be-9aa3-1a31d0ff38cb None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:35.240613 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:35.293298 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0497ed-ba93-40e8-9497-1ef8bdf03e21 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:35.294298 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0497ed-ba93-40e8-9497-1ef8bdf03e21 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:35.294785 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0497ed-ba93-40e8-9497-1ef8bdf03e21 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:35.295260 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d0497ed-ba93-40e8-9497-1ef8bdf03e21 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:35.318609 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0497ed-ba93-40e8-9497-1ef8bdf03e21 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:35.321231 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d0497ed-ba93-40e8-9497-1ef8bdf03e21 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:35.349261 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-2d0497ed-ba93-40e8-9497-1ef8bdf03e21 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:35.349261 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:35.349261 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:35.349261 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:35.349261 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:35.349261 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:35.349261 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:35.349261 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:35.349261 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:35.349261 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:35.349261 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:35.349261 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:35.349261 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:35.349261 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:35.349261 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:35.349261 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:35.351247 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:35.351247 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:35.351247 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:35.351247 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:35.351247 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:35.351247 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:35.351247 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:35.351247 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:35.351247 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:35.351247 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:35.351247 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:35.351247 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:35.351247 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:35.351247 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:35.351247 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:35.351247 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:35.351247 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:35.353191 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:35.353191 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:35.353191 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:56:35.357633 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 626/1256] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:35 2022] GET /identity/v3/domains/Default => generated 87 bytes in 324 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:35.361270 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cc75e-206a-49a9-8677-42a9684dffe1 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:35.527610 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:35.549779 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-594cc75e-206a-49a9-8677-42a9684dffe1 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:35.616514 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68976b20-27bf-4872-997a-cf7734040c3f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:35.617553 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68976b20-27bf-4872-997a-cf7734040c3f None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:35.618029 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68976b20-27bf-4872-997a-cf7734040c3f None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:35.618494 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-68976b20-27bf-4872-997a-cf7734040c3f None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:35.619673 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68976b20-27bf-4872-997a-cf7734040c3f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:35.620330 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68976b20-27bf-4872-997a-cf7734040c3f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:35.622785 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-68976b20-27bf-4872-997a-cf7734040c3f None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:35.652734 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 631/1257] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:35 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 286 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:35.655968 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0497ed-ba93-40e8-9497-1ef8bdf03e21 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:35.846903 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d0497ed-ba93-40e8-9497-1ef8bdf03e21 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:35.923136 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88c8d1-6206-4671-a733-0d329b00d65a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:35.924119 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88c8d1-6206-4671-a733-0d329b00d65a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:35.924609 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88c8d1-6206-4671-a733-0d329b00d65a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:35.925104 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-db88c8d1-6206-4671-a733-0d329b00d65a None admin] PATH_INFO: `/v3/projects/service` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:35.945521 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88c8d1-6206-4671-a733-0d329b00d65a None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:35.948282 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-db88c8d1-6206-4671-a733-0d329b00d65a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:35.969818 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-db88c8d1-6206-4671-a733-0d329b00d65a None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:35.969818 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:35.969818 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:35.969818 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:35.969818 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:35.969818 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:35.969818 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:35.969818 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:35.969818 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:35.969818 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:35.969818 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:35.969818 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:35.969818 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:35.969818 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:35.969818 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:35.971740 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:35.971740 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:35.971740 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:35.971740 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:35.971740 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:35.971740 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:35.971740 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:35.971740 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:35.971740 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:35.971740 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:35.971740 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:35.971740 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:35.971740 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:35.971740 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:35.971740 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:35.971740 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:35.971740 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:35.973362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:35.973362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:35.973362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:35.973362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:35.973362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:35.973362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:35.973362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:35.973362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:56:35.973362 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 627/1258] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:35 2022] GET /identity/v3/projects/service => generated 88 bytes in 317 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:35.985482 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68976b20-27bf-4872-997a-cf7734040c3f None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:36.178949 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-68976b20-27bf-4872-997a-cf7734040c3f None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:36.251546 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7d379629-c98f-4bef-beab-74f0f4b1fee8 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:36.252384 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d379629-c98f-4bef-beab-74f0f4b1fee8 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:36.252676 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d379629-c98f-4bef-beab-74f0f4b1fee8 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:36.253076 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7d379629-c98f-4bef-beab-74f0f4b1fee8 None admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:36.254456 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d379629-c98f-4bef-beab-74f0f4b1fee8 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:36.254877 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d379629-c98f-4bef-beab-74f0f4b1fee8 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:36.257429 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7d379629-c98f-4bef-beab-74f0f4b1fee8 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:36.288168 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 632/1259] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:35 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 296 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:36.289738 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88c8d1-6206-4671-a733-0d329b00d65a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:36.333847 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:36.454111 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-db88c8d1-6206-4671-a733-0d329b00d65a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:36.523332 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-311924f1-e411-40a0-b0ea-568f9a9d3d39 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:36.524129 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311924f1-e411-40a0-b0ea-568f9a9d3d39 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:36.524524 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311924f1-e411-40a0-b0ea-568f9a9d3d39 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:36.524904 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-311924f1-e411-40a0-b0ea-568f9a9d3d39 None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:36.526093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311924f1-e411-40a0-b0ea-568f9a9d3d39 None admin] RBAC: Adding query filter params (role.id=c73e9539582145ed8eedc48648b9d738, scope.project.id=838e996d09a0454b9bcdc5aef03ef203, user.id=3a225f81f16e4cf2a1e62bbb3ec8eee0) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:36.526572 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311924f1-e411-40a0-b0ea-568f9a9d3d39 None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:36.528243 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-311924f1-e411-40a0-b0ea-568f9a9d3d39 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:36.536987 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 628/1260] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:56:36 2022] GET /identity/v3/role_assignments?user.id=3a225f81f16e4cf2a1e62bbb3ec8eee0&scope.project.id=838e996d09a0454b9bcdc5aef03ef203&role.id=c73e9539582145ed8eedc48648b9d738 => generated 259 bytes in 248 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:39.251828 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eacdf8-d4b3-4034-88da-fb2eed5c4b53 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:39.252393 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eacdf8-d4b3-4034-88da-fb2eed5c4b53 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:39.252644 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a2eacdf8-d4b3-4034-88da-fb2eed5c4b53 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:39.254908 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 633/1261] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:56:39 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:39.263417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efb1d7-5277-4c70-9197-fb1c50f161e8 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:39.263986 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efb1d7-5277-4c70-9197-fb1c50f161e8 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:39.263986 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17efb1d7-5277-4c70-9197-fb1c50f161e8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:39.286078 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-17efb1d7-5277-4c70-9197-fb1c50f161e8 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:39.287323 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-17efb1d7-5277-4c70-9197-fb1c50f161e8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:39.364771 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 629/1262] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:39 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:56:39.632054 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eacdf8-d4b3-4034-88da-fb2eed5c4b53 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:39.647187 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:39.761531 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a2eacdf8-d4b3-4034-88da-fb2eed5c4b53 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:39.801515 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a9109-59ea-4f82-b09e-55423f5663f0 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:39.802164 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a9109-59ea-4f82-b09e-55423f5663f0 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:39.802423 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a9109-59ea-4f82-b09e-55423f5663f0 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:39.802689 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-657a9109-59ea-4f82-b09e-55423f5663f0 None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:39.817546 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-657a9109-59ea-4f82-b09e-55423f5663f0 None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:39.825506 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-657a9109-59ea-4f82-b09e-55423f5663f0 None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:56:39.825506 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:39.825506 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:39.825506 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:39.825506 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:39.825506 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:39.825506 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:39.825506 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:39.825506 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:39.825506 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:39.825506 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:39.825506 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:39.825506 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:39.825506 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:39.825506 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:39.825506 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:39.827323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:39.827323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:39.827323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:39.827323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:39.827323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:39.827323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:39.827323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:39.827323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:39.827323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:39.827323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:39.827323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:39.827323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:39.827323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:39.827323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:39.827323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:39.827323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:39.828844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:39.828844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:39.828844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:39.828844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:39.828844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:39.828844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:39.828844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:39.828844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:39.828844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:39.828844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:39.828844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:56:39.828844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:56:39.828844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 634/1263] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:56:39 2022] GET /identity/v3/roles/admin => generated 83 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:39.834486 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efb1d7-5277-4c70-9197-fb1c50f161e8 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:39.859829 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:39.970349 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17efb1d7-5277-4c70-9197-fb1c50f161e8 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:40.006725 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a90134-3146-4d5a-87dc-ec3b3724b963 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:40.007457 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a90134-3146-4d5a-87dc-ec3b3724b963 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:40.007790 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a90134-3146-4d5a-87dc-ec3b3724b963 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:40.008172 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86a90134-3146-4d5a-87dc-ec3b3724b963 None admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:40.008898 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a90134-3146-4d5a-87dc-ec3b3724b963 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:40.009268 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a90134-3146-4d5a-87dc-ec3b3724b963 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:40.010793 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86a90134-3146-4d5a-87dc-ec3b3724b963 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:40.020151 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 630/1264] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:56:39 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 187 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:40.026906 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a9109-59ea-4f82-b09e-55423f5663f0 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:40.108109 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:40.149536 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-657a9109-59ea-4f82-b09e-55423f5663f0 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:40.190825 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d2572-9b60-4e84-992a-2cae256bebd5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:40.191288 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d2572-9b60-4e84-992a-2cae256bebd5 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:40.191562 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d2572-9b60-4e84-992a-2cae256bebd5 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:40.191829 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a1d2572-9b60-4e84-992a-2cae256bebd5 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:40.203436 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d2572-9b60-4e84-992a-2cae256bebd5 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:40.205102 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a1d2572-9b60-4e84-992a-2cae256bebd5 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:40.221384 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-1a1d2572-9b60-4e84-992a-2cae256bebd5 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:40.221384 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:40.221384 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:40.221384 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:40.221384 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:40.221384 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:40.221384 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:40.221384 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:40.221384 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:40.221384 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:40.221384 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:40.221384 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:40.221384 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:40.221384 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:40.221384 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:40.221384 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:40.222706 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:40.222706 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:40.222706 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:40.222706 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:40.222706 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:40.222706 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:40.222706 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:40.222706 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:40.222706 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:40.222706 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:40.222706 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:40.222706 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:40.222706 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:40.222706 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:40.222706 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:40.222706 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:40.222706 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:40.224390 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:40.224390 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:40.224390 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:56:40.224390 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 635/1265] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 197 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:40.230021 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a90134-3146-4d5a-87dc-ec3b3724b963 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:40.326111 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:40.358307 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86a90134-3146-4d5a-87dc-ec3b3724b963 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:40.418178 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1869b66-2ead-4acb-84bc-a0a751bff005 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:40.419214 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1869b66-2ead-4acb-84bc-a0a751bff005 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:40.419710 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1869b66-2ead-4acb-84bc-a0a751bff005 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:40.420197 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1869b66-2ead-4acb-84bc-a0a751bff005 None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:40.421426 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1869b66-2ead-4acb-84bc-a0a751bff005 None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:40.421951 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1869b66-2ead-4acb-84bc-a0a751bff005 None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:40.424491 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1869b66-2ead-4acb-84bc-a0a751bff005 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:40.447152 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 631/1266] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 218 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:40.453386 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d2572-9b60-4e84-992a-2cae256bebd5 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:40.557564 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a1d2572-9b60-4e84-992a-2cae256bebd5 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:40.578066 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:40.592497 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30f40a-56e8-476d-b57f-f14017a86695 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:40.593164 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30f40a-56e8-476d-b57f-f14017a86695 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:40.593440 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30f40a-56e8-476d-b57f-f14017a86695 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:40.593706 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f30f40a-56e8-476d-b57f-f14017a86695 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:40.601634 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30f40a-56e8-476d-b57f-f14017a86695 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:40.603092 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f30f40a-56e8-476d-b57f-f14017a86695 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:40.614731 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-5f30f40a-56e8-476d-b57f-f14017a86695 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:56:40.614731 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:40.614731 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:40.614731 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:40.614731 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:40.614731 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:40.614731 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:40.614731 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:40.614731 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:40.614731 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:40.614731 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:40.614731 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:40.614731 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:40.614731 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:40.614731 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:40.614731 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:40.616598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:40.616598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:40.616598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:40.616598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:40.616598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:40.616598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:40.616598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:40.616598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:40.616598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:40.616598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:40.616598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:40.616598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:40.616598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:40.616598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:40.616598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:40.616598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:40.616598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:40.616598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:40.618714 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:40.618714 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:40.618714 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:40.618714 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:40.618714 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:40.618714 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:40.618714 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:40.618714 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:40.618714 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:56:40.618714 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:56:40.618714 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 636/1267] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:40 2022] GET /identity/v3/users/placement => generated 87 bytes in 163 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:40.622103 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1869b66-2ead-4acb-84bc-a0a751bff005 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:40.731059 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1869b66-2ead-4acb-84bc-a0a751bff005 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:40.767760 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8138ac0-9d95-4a69-8bef-c0eae784fb01 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:40.768343 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8138ac0-9d95-4a69-8bef-c0eae784fb01 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:40.768639 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8138ac0-9d95-4a69-8bef-c0eae784fb01 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:40.768892 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c8138ac0-9d95-4a69-8bef-c0eae784fb01 None admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:40.769649 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8138ac0-9d95-4a69-8bef-c0eae784fb01 None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:40.769962 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8138ac0-9d95-4a69-8bef-c0eae784fb01 None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:40.771386 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c8138ac0-9d95-4a69-8bef-c0eae784fb01 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:40.781896 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:40.791869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 632/1268] 10.222.0.49 () {56 vars in 1143 bytes} [Sun Aug 21 00:56:40 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 170 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:40.797934 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30f40a-56e8-476d-b57f-f14017a86695 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:40.918290 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f30f40a-56e8-476d-b57f-f14017a86695 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:40.959460 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ff518-ae06-4b46-bae7-afd86ac24113 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:40.960166 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ff518-ae06-4b46-bae7-afd86ac24113 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:40.960521 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ff518-ae06-4b46-bae7-afd86ac24113 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:40.960933 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-717ff518-ae06-4b46-bae7-afd86ac24113 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:40.974729 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ff518-ae06-4b46-bae7-afd86ac24113 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:40.976590 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-717ff518-ae06-4b46-bae7-afd86ac24113 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:40.992248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-717ff518-ae06-4b46-bae7-afd86ac24113 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:40.992248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:40.992248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:40.992248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:40.992248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:40.992248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:40.992248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:40.992248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:40.992248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:40.992248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:40.992248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:40.992248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:40.992248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:40.992248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:40.992248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:40.992248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:40.993923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:40.993923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:40.993923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:40.993923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:40.993923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:40.993923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:40.993923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:40.993923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:40.993923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:40.993923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:40.993923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:40.993923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:40.993923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:40.993923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:40.993923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:40.993923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:40.993923 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:40.995410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:40.995410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:40.995410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:56:40.995410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 637/1269] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:40 2022] GET /identity/v3/domains/Default => generated 87 bytes in 196 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:41.000082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8138ac0-9d95-4a69-8bef-c0eae784fb01 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:41.106274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c8138ac0-9d95-4a69-8bef-c0eae784fb01 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:41.142792 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da62613-41eb-4f6c-af10-b078d45ec04f None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:41.143406 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da62613-41eb-4f6c-af10-b078d45ec04f None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:41.143678 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da62613-41eb-4f6c-af10-b078d45ec04f None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:41.143944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da62613-41eb-4f6c-af10-b078d45ec04f None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:41.144593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da62613-41eb-4f6c-af10-b078d45ec04f None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:41.144891 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da62613-41eb-4f6c-af10-b078d45ec04f None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:41.146298 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0da62613-41eb-4f6c-af10-b078d45ec04f None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:41.158645 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 633/1270] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:40 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 159 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:41.164865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ff518-ae06-4b46-bae7-afd86ac24113 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:41.201113 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:41.279183 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-717ff518-ae06-4b46-bae7-afd86ac24113 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:41.319016 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2827cf-50ab-4d1a-9434-09526a6cb7b5 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:41.319667 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2827cf-50ab-4d1a-9434-09526a6cb7b5 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:41.319944 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2827cf-50ab-4d1a-9434-09526a6cb7b5 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:41.320216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f2827cf-50ab-4d1a-9434-09526a6cb7b5 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:41.327921 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2827cf-50ab-4d1a-9434-09526a6cb7b5 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:41.329448 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f2827cf-50ab-4d1a-9434-09526a6cb7b5 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:41.343677 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-3f2827cf-50ab-4d1a-9434-09526a6cb7b5 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:41.343677 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:41.343677 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:41.343677 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:41.343677 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:41.343677 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:41.343677 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:41.343677 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:41.343677 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:41.343677 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:41.343677 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:41.343677 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:41.343677 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:41.343677 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:41.343677 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:41.345745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:41.345745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:41.345745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:41.345745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:41.345745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:41.345745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:41.345745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:41.345745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:41.345745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:41.345745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:41.345745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:41.345745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:41.345745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:41.345745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:41.345745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:41.345745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:41.345745 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:41.347715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:41.347715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:41.347715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:41.347715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:41.347715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:41.347715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:41.347715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:41.347715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:56:41.347715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 638/1271] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:41 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:41.351321 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da62613-41eb-4f6c-af10-b078d45ec04f None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:41.422449 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:41.467470 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da62613-41eb-4f6c-af10-b078d45ec04f None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:41.504700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-683cb08c-e859-4573-8b95-c671faca5dff None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:41.505350 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cb08c-e859-4573-8b95-c671faca5dff None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:41.505623 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cb08c-e859-4573-8b95-c671faca5dff None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:41.505885 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-683cb08c-e859-4573-8b95-c671faca5dff None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:41.506575 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cb08c-e859-4573-8b95-c671faca5dff None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:41.506874 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cb08c-e859-4573-8b95-c671faca5dff None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:41.508306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-683cb08c-e859-4573-8b95-c671faca5dff None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:41.521561 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 634/1272] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:41 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 171 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:41.528575 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2827cf-50ab-4d1a-9434-09526a6cb7b5 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:41.658356 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:41.670173 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f2827cf-50ab-4d1a-9434-09526a6cb7b5 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:41.725029 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ab03f776-3014-400c-9195-8d61e9acd7a1 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:41.725629 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03f776-3014-400c-9195-8d61e9acd7a1 None admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:41.725912 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03f776-3014-400c-9195-8d61e9acd7a1 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:41.726183 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ab03f776-3014-400c-9195-8d61e9acd7a1 None admin] PATH_INFO: `/v3/projects/838e996d09a0454b9bcdc5aef03ef203/users/3a225f81f16e4cf2a1e62bbb3ec8eee0/roles/c73e9539582145ed8eedc48648b9d738` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:41.728146 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03f776-3014-400c-9195-8d61e9acd7a1 None admin] RBAC: Authorizing `identity:create_grant(project_id=838e996d09a0454b9bcdc5aef03ef203, user_id=3a225f81f16e4cf2a1e62bbb3ec8eee0, role_id=c73e9539582145ed8eedc48648b9d738)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:41.729695 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ab03f776-3014-400c-9195-8d61e9acd7a1 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:41.744326 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 639/1273] 10.222.0.49 () {58 vars in 1439 bytes} [Sun Aug 21 00:56:41 2022] PUT /identity/v3/projects/838e996d09a0454b9bcdc5aef03ef203/users/3a225f81f16e4cf2a1e62bbb3ec8eee0/roles/c73e9539582145ed8eedc48648b9d738 => generated 0 bytes in 216 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 00:56:43.757374 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da4b85-b123-4044-a8e4-ab9405e027ab None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:43.758000 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da4b85-b123-4044-a8e4-ab9405e027ab None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:43.758000 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c6da4b85-b123-4044-a8e4-ab9405e027ab None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:43.759322 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 635/1274] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:56:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:43.765717 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252d71e-5548-4514-87c3-bbe49b8eb8fd None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:43.766307 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252d71e-5548-4514-87c3-bbe49b8eb8fd None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:43.766307 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e252d71e-5548-4514-87c3-bbe49b8eb8fd None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:43.787274 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-e252d71e-5548-4514-87c3-bbe49b8eb8fd None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:43.788460 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-e252d71e-5548-4514-87c3-bbe49b8eb8fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:43.883515 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 640/1275] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:43 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 119 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:56:44.150822 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da4b85-b123-4044-a8e4-ab9405e027ab None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:44.262239 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c6da4b85-b123-4044-a8e4-ab9405e027ab None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:44.280604 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:44.298843 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aca5c4-fb38-4fa3-874e-1180cfa27efa None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:44.299558 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aca5c4-fb38-4fa3-874e-1180cfa27efa None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:44.299744 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aca5c4-fb38-4fa3-874e-1180cfa27efa None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:44.300007 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22aca5c4-fb38-4fa3-874e-1180cfa27efa None admin] PATH_INFO: `/v3/roles/admin` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:44.310573 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-22aca5c4-fb38-4fa3-874e-1180cfa27efa None admin] Extracting inferred target data resulted in "NOT FOUND (404)". {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:409}} Aug 21 00:56:44.315227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-22aca5c4-fb38-4fa3-874e-1180cfa27efa None admin] Could not find role: admin.: keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:56:44.315227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:44.315227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:44.315227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:44.315227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:44.315227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:44.315227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:44.315227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:44.315227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:44.315227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:44.315227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:44.315227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:44.315227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 50, in get Aug 21 00:56:44.315227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(role_id) Aug 21 00:56:44.315227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/roles.py", line 70, in _get_role Aug 21 00:56:44.315227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ENFORCER.enforce_call(action='identity:get_role') Aug 21 00:56:44.316967 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 402, in enforce_call Aug 21 00:56:44.316967 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application policy_dict.update(cls._extract_member_target_data( Aug 21 00:56:44.316967 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py", line 234, in _extract_member_target_data Aug 21 00:56:44.316967 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application member_name: func(flask.request.view_args[key]) Aug 21 00:56:44.316967 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:44.316967 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:44.316967 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:44.316967 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:44.316967 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:44.316967 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:44.316967 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:44.316967 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:44.316967 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:44.316967 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:44.316967 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:44.316967 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:44.318599 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:44.318599 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:44.318599 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:44.318599 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:44.318599 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/core.py", line 1276, in get_role Aug 21 00:56:44.318599 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_role(role_id) Aug 21 00:56:44.318599 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 70, in get_role Aug 21 00:56:44.318599 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_role(session, role_id).to_dict() Aug 21 00:56:44.318599 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/assignment/role_backends/sql.py", line 65, in _get_role Aug 21 00:56:44.318599 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.RoleNotFound(role_id=role_id) Aug 21 00:56:44.318599 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.RoleNotFound: Could not find role: admin. Aug 21 00:56:44.318599 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:56:44.318599 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 636/1276] 10.222.0.49 () {56 vars in 1096 bytes} [Sun Aug 21 00:56:44 2022] GET /identity/v3/roles/admin => generated 83 bytes in 166 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:44.326640 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252d71e-5548-4514-87c3-bbe49b8eb8fd None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:44.415099 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:44.436202 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e252d71e-5548-4514-87c3-bbe49b8eb8fd None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:44.472786 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ceff9-fade-4a47-a0fb-b90a7695ab80 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:44.473591 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ceff9-fade-4a47-a0fb-b90a7695ab80 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:44.473981 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ceff9-fade-4a47-a0fb-b90a7695ab80 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:44.474342 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b43ceff9-fade-4a47-a0fb-b90a7695ab80 None admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:44.475140 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ceff9-fade-4a47-a0fb-b90a7695ab80 None admin] RBAC: Adding query filter params (name=admin) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:44.475535 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ceff9-fade-4a47-a0fb-b90a7695ab80 None admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:44.477085 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b43ceff9-fade-4a47-a0fb-b90a7695ab80 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:44.486807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 641/1277] 10.222.0.49 () {56 vars in 1099 bytes} [Sun Aug 21 00:56:44 2022] GET /identity/v3/roles?name=admin => generated 339 bytes in 161 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:44.493495 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aca5c4-fb38-4fa3-874e-1180cfa27efa None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:44.658099 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22aca5c4-fb38-4fa3-874e-1180cfa27efa None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:44.696415 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0be29-49cb-4bfa-9144-9c9cffd47985 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:44.697131 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0be29-49cb-4bfa-9144-9c9cffd47985 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:44.697458 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0be29-49cb-4bfa-9144-9c9cffd47985 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:44.697832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f8c0be29-49cb-4bfa-9144-9c9cffd47985 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:44.709166 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0be29-49cb-4bfa-9144-9c9cffd47985 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:44.710644 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f8c0be29-49cb-4bfa-9144-9c9cffd47985 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:44.726542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-f8c0be29-49cb-4bfa-9144-9c9cffd47985 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:44.726542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:44.726542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:44.726542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:44.726542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:44.726542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:44.726542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:44.726542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:44.726542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:44.726542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:44.726542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:44.726542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:44.726542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:44.726542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:44.726542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:44.726542 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:44.728274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:44.728274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:44.728274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:44.728274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:44.728274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:44.728274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:44.728274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:44.728274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:44.728274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:44.728274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:44.728274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:44.728274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:44.728274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:44.728274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:44.728274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:44.728274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:44.728274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:44.729804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:44.729804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:44.729804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:56:44.729804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 637/1278] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:44 2022] GET /identity/v3/domains/Default => generated 87 bytes in 235 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:44.734256 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ceff9-fade-4a47-a0fb-b90a7695ab80 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:44.849875 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b43ceff9-fade-4a47-a0fb-b90a7695ab80 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:44.893551 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb648fea-697b-4332-871a-21f34b22b22a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:44.894578 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb648fea-697b-4332-871a-21f34b22b22a None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:44.895055 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb648fea-697b-4332-871a-21f34b22b22a None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:44.895535 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb648fea-697b-4332-871a-21f34b22b22a None admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:44.896747 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb648fea-697b-4332-871a-21f34b22b22a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:44.897290 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb648fea-697b-4332-871a-21f34b22b22a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:44.899837 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fb648fea-697b-4332-871a-21f34b22b22a None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:44.921472 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 642/1279] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:44 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 188 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:44.930998 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0be29-49cb-4bfa-9144-9c9cffd47985 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:44.968785 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:45.046778 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f8c0be29-49cb-4bfa-9144-9c9cffd47985 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:45.086946 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221e7f4-09df-473c-8cf0-fba63244b433 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:45.087603 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221e7f4-09df-473c-8cf0-fba63244b433 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:45.087862 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221e7f4-09df-473c-8cf0-fba63244b433 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:45.088131 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e221e7f4-09df-473c-8cf0-fba63244b433 None admin] PATH_INFO: `/v3/users/placement` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:45.096694 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e221e7f4-09df-473c-8cf0-fba63244b433 None admin] RBAC: Authorizing `identity:get_user(user_id=placement)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:45.098312 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e221e7f4-09df-473c-8cf0-fba63244b433 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:45.111067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-e221e7f4-09df-473c-8cf0-fba63244b433 None admin] Could not find user: placement.: keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:56:45.111067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:45.111067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:45.111067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:45.111067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:45.111067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:45.111067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:45.111067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:45.111067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:45.111067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:45.111067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:45.111067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:45.111067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 182, in get Aug 21 00:56:45.111067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_user(user_id) Aug 21 00:56:45.111067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/users.py", line 194, in _get_user Aug 21 00:56:45.111067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = PROVIDERS.identity_api.get_user(user_id) Aug 21 00:56:45.112758 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:45.112758 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:45.112758 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 414, in wrapper Aug 21 00:56:45.112758 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:45.112758 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 424, in wrapper Aug 21 00:56:45.112758 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return f(self, *args, **kwargs) Aug 21 00:56:45.112758 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:45.112758 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:45.112758 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:45.112758 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:45.112758 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:45.112758 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:45.112758 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:45.112758 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:45.112758 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:45.112758 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:45.112758 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:45.112758 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:45.114211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:45.114211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:45.114211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/core.py", line 1011, in get_user Aug 21 00:56:45.114211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application ref = driver.get_user(entity_id) Aug 21 00:56:45.114211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 200, in get_user Aug 21 00:56:45.114211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application self._get_user(session, user_id).to_dict()) Aug 21 00:56:45.114211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/identity/backends/sql.py", line 194, in _get_user Aug 21 00:56:45.114211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.UserNotFound(user_id=user_id) Aug 21 00:56:45.114211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.UserNotFound: Could not find user: placement. Aug 21 00:56:45.114211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:56:45.114211 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 638/1280] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:44 2022] GET /identity/v3/users/placement => generated 87 bytes in 183 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:45.122126 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb648fea-697b-4332-871a-21f34b22b22a None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:45.128534 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:45.280042 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb648fea-697b-4332-871a-21f34b22b22a None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:45.336116 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1f24b-0c9e-48f6-9717-b1e6d3e77d1d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:45.336762 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1f24b-0c9e-48f6-9717-b1e6d3e77d1d None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:45.336996 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1f24b-0c9e-48f6-9717-b1e6d3e77d1d None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:45.337301 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-29e1f24b-0c9e-48f6-9717-b1e6d3e77d1d None admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:45.338038 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1f24b-0c9e-48f6-9717-b1e6d3e77d1d None admin] RBAC: Adding query filter params (domain_id=default, name=placement) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:45.338337 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1f24b-0c9e-48f6-9717-b1e6d3e77d1d None admin] RBAC: Authorizing `identity:list_users()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:45.339829 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-29e1f24b-0c9e-48f6-9717-b1e6d3e77d1d None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:45.359148 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 643/1281] 10.222.0.49 () {56 vars in 1143 bytes} [Sun Aug 21 00:56:45 2022] GET /identity/v3/users?domain_id=default&name=placement => generated 378 bytes in 238 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:45.368814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221e7f4-09df-473c-8cf0-fba63244b433 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:45.502356 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:45.516949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e221e7f4-09df-473c-8cf0-fba63244b433 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:45.574577 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12854104-868b-4e20-9c1f-0316e7979a72 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:45.575116 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12854104-868b-4e20-9c1f-0316e7979a72 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:45.575367 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12854104-868b-4e20-9c1f-0316e7979a72 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:45.575620 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-12854104-868b-4e20-9c1f-0316e7979a72 None admin] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:45.661943 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12854104-868b-4e20-9c1f-0316e7979a72 None admin] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:45.663796 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-12854104-868b-4e20-9c1f-0316e7979a72 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:45.787385 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:45.798637 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 639/1282] 10.222.0.49 () {58 vars in 1282 bytes} [Sun Aug 21 00:56:45 2022] GET /identity/v3/auth/tokens => generated 2118 bytes in 431 msecs (HTTP/1.1 200) 6 headers in 359 bytes (1 switches on core 0) Aug 21 00:56:45.804804 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1f24b-0c9e-48f6-9717-b1e6d3e77d1d None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:45.890475 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:45.955715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-29e1f24b-0c9e-48f6-9717-b1e6d3e77d1d None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:45.994748 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c3450-db75-48bc-a1b6-5c057e7e7018 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:45.995453 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c3450-db75-48bc-a1b6-5c057e7e7018 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:45.995764 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c3450-db75-48bc-a1b6-5c057e7e7018 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:45.996070 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ea8c3450-db75-48bc-a1b6-5c057e7e7018 None admin] PATH_INFO: `/v3/domains/Default` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:46.011673 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c3450-db75-48bc-a1b6-5c057e7e7018 None admin] RBAC: Authorizing `identity:get_domain(domain_id=Default)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:46.013243 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ea8c3450-db75-48bc-a1b6-5c057e7e7018 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:46.029414 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-ea8c3450-db75-48bc-a1b6-5c057e7e7018 None admin] Could not find domain: Default.: keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:46.029414 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:46.029414 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:46.029414 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:46.029414 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:46.029414 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:46.029414 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:46.029414 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:46.029414 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:46.029414 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:46.029414 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:46.029414 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:46.029414 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 89, in get Aug 21 00:56:46.029414 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_domain(domain_id) Aug 21 00:56:46.029414 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/domains.py", line 97, in _get_domain Aug 21 00:56:46.029414 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application domain = PROVIDERS.resource_api.get_domain(domain_id) Aug 21 00:56:46.030647 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:46.030647 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:46.030647 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:46.030647 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:46.030647 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:46.030647 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:46.030647 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:46.030647 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:46.030647 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:46.030647 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:46.030647 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:46.030647 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:46.030647 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:46.030647 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:46.030647 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:46.030647 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:46.030647 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 716, in get_domain Aug 21 00:56:46.032051 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.DomainNotFound(domain_id=domain_id) Aug 21 00:56:46.032051 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.DomainNotFound: Could not find domain: Default. Aug 21 00:56:46.032051 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:56:46.032051 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 644/1283] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 00:56:45 2022] GET /identity/v3/domains/Default => generated 87 bytes in 226 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:46.037476 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12854104-868b-4e20-9c1f-0316e7979a72 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:46.157726 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-12854104-868b-4e20-9c1f-0316e7979a72 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:46.201001 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9aaf72-71c7-493d-9674-cb7605bde35a None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:46.201971 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9aaf72-71c7-493d-9674-cb7605bde35a None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:46.202127 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9aaf72-71c7-493d-9674-cb7605bde35a None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:46.202512 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-da9aaf72-71c7-493d-9674-cb7605bde35a None admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:46.203238 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9aaf72-71c7-493d-9674-cb7605bde35a None admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:46.203546 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9aaf72-71c7-493d-9674-cb7605bde35a None admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:46.205212 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-da9aaf72-71c7-493d-9674-cb7605bde35a None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:46.220944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 640/1284] 10.222.0.49 () {56 vars in 1109 bytes} [Sun Aug 21 00:56:46 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 185 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:46.227843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c3450-db75-48bc-a1b6-5c057e7e7018 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:46.345909 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ea8c3450-db75-48bc-a1b6-5c057e7e7018 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:46.361760 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:46.384958 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f772e4-103a-48ff-a42e-37e71bcc8ec4 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:46.385836 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f772e4-103a-48ff-a42e-37e71bcc8ec4 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:46.386118 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f772e4-103a-48ff-a42e-37e71bcc8ec4 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:46.386388 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96f772e4-103a-48ff-a42e-37e71bcc8ec4 None admin] PATH_INFO: `/v3/projects/service` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:46.393682 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f772e4-103a-48ff-a42e-37e71bcc8ec4 None admin] RBAC: Authorizing `identity:get_project(project_id=service)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:46.395162 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96f772e4-103a-48ff-a42e-37e71bcc8ec4 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:46.407190 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application [None req-96f772e4-103a-48ff-a42e-37e71bcc8ec4 None admin] Could not find project: service.: keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:46.407190 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:46.407190 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:46.407190 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:46.407190 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:46.407190 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:46.407190 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:46.407190 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:46.407190 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:46.407190 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:46.407190 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:46.407190 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:46.407190 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 151, in get Aug 21 00:56:46.407190 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(project_id) Aug 21 00:56:46.407190 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/projects.py", line 107, in _get_project Aug 21 00:56:46.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application project = PROVIDERS.resource_api.get_project(project_id) Aug 21 00:56:46.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:46.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:46.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:46.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:46.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:46.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:46.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:46.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:46.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:46.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:46.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:46.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:46.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:46.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:46.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:46.408339 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:46.409490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/core.py", line 903, in get_project Aug 21 00:56:46.409490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self.driver.get_project(project_id) Aug 21 00:56:46.409490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 49, in get_project Aug 21 00:56:46.409490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application return self._get_project(session, project_id).to_dict() Aug 21 00:56:46.409490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/resource/backends/sql.py", line 44, in _get_project Aug 21 00:56:46.409490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application raise exception.ProjectNotFound(project_id=project_id) Aug 21 00:56:46.409490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application keystone.exception.ProjectNotFound: Could not find project: service. Aug 21 00:56:46.409490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: ERROR keystone.server.flask.application Aug 21 00:56:46.409490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 645/1285] 10.222.0.49 () {56 vars in 1111 bytes} [Sun Aug 21 00:56:46 2022] GET /identity/v3/projects/service => generated 88 bytes in 181 msecs (HTTP/1.1 404) 5 headers in 183 bytes (2 switches on core 0) Aug 21 00:56:46.414524 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9aaf72-71c7-493d-9674-cb7605bde35a None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:46.472520 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:46.529777 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-da9aaf72-71c7-493d-9674-cb7605bde35a None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:46.567493 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0d5bd67e-2c3a-4a0a-b6eb-637a50e0cc52 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:46.568182 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bd67e-2c3a-4a0a-b6eb-637a50e0cc52 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:46.568499 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bd67e-2c3a-4a0a-b6eb-637a50e0cc52 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:46.568811 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0d5bd67e-2c3a-4a0a-b6eb-637a50e0cc52 None admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:46.569630 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5bd67e-2c3a-4a0a-b6eb-637a50e0cc52 None admin] RBAC: Adding query filter params (domain_id=default, name=service) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:46.569967 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5bd67e-2c3a-4a0a-b6eb-637a50e0cc52 None admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:46.571459 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0d5bd67e-2c3a-4a0a-b6eb-637a50e0cc52 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:46.588184 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 641/1286] 10.222.0.49 () {56 vars in 1148 bytes} [Sun Aug 21 00:56:46 2022] GET /identity/v3/projects?domain_id=default&name=service => generated 429 bytes in 174 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:46.595420 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f772e4-103a-48ff-a42e-37e71bcc8ec4 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:46.721881 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96f772e4-103a-48ff-a42e-37e71bcc8ec4 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:46.767890 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1053c2d3-ade6-4575-8f44-a94a27b399bf None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:46.768922 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053c2d3-ade6-4575-8f44-a94a27b399bf None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:46.769460 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053c2d3-ade6-4575-8f44-a94a27b399bf None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:46.769928 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1053c2d3-ade6-4575-8f44-a94a27b399bf None admin] PATH_INFO: `/v3/role_assignments` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:46.771262 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053c2d3-ade6-4575-8f44-a94a27b399bf None admin] RBAC: Adding query filter params (role.id=c73e9539582145ed8eedc48648b9d738, scope.project.id=838e996d09a0454b9bcdc5aef03ef203, user.id=3a225f81f16e4cf2a1e62bbb3ec8eee0) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:46.771786 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053c2d3-ade6-4575-8f44-a94a27b399bf None admin] RBAC: Authorizing `identity:list_role_assignments()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:46.774518 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1053c2d3-ade6-4575-8f44-a94a27b399bf None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:46.786434 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 646/1287] 10.222.0.49 () {56 vars in 1374 bytes} [Sun Aug 21 00:56:46 2022] GET /identity/v3/role_assignments?user.id=3a225f81f16e4cf2a1e62bbb3ec8eee0&scope.project.id=838e996d09a0454b9bcdc5aef03ef203&role.id=c73e9539582145ed8eedc48648b9d738 => generated 608 bytes in 192 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:48.775065 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265afe07-881a-41f9-aa49-d1c9dc7ce631 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:48.775632 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265afe07-881a-41f9-aa49-d1c9dc7ce631 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:48.775632 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-265afe07-881a-41f9-aa49-d1c9dc7ce631 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:48.777234 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 642/1288] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:56:48 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:48.783349 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8debc-773d-4cfd-b705-3b7a9dbb9c24 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:48.784168 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8debc-773d-4cfd-b705-3b7a9dbb9c24 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:48.784168 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71a8debc-773d-4cfd-b705-3b7a9dbb9c24 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:48.802991 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-71a8debc-773d-4cfd-b705-3b7a9dbb9c24 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:48.804209 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-71a8debc-773d-4cfd-b705-3b7a9dbb9c24 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:48.843375 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:48.892267 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 647/1289] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:48 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 110 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:56:49.162739 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265afe07-881a-41f9-aa49-d1c9dc7ce631 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:49.293018 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-265afe07-881a-41f9-aa49-d1c9dc7ce631 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:49.307709 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:49.348907 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b4efe-0c3b-43c3-a787-eeaef3ed1439 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:49.350004 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b4efe-0c3b-43c3-a787-eeaef3ed1439 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:49.350493 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b4efe-0c3b-43c3-a787-eeaef3ed1439 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:49.350959 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c28b4efe-0c3b-43c3-a787-eeaef3ed1439 None admin] PATH_INFO: `/v3/services/placement` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:49.351999 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b4efe-0c3b-43c3-a787-eeaef3ed1439 None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:49.354509 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c28b4efe-0c3b-43c3-a787-eeaef3ed1439 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:49.371500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-c28b4efe-0c3b-43c3-a787-eeaef3ed1439 None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 00:56:49.371500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:49.371500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:56:49.371500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:56:49.371500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:56:49.371500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:56:49.371500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:56:49.371500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:56:49.371500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 00:56:49.371500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:56:49.371500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:56:49.371500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:56:49.371500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:49.371500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:49.371500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:49.371500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:49.371500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:49.372986 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:49.372986 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:49.372986 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:49.372986 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:49.372986 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:49.372986 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:49.372986 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:56:49.372986 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:56:49.372986 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:56:49.372986 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:56:49.372986 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:49.372986 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:49.372986 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:49.372986 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:49.372986 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:49.372986 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:49.374165 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:49.374165 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:49.374165 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:49.374165 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:49.374165 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:49.374165 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:49.374165 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:49.374165 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:49.374165 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:49.374165 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:49.374165 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:56:49.374165 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:56:49.374165 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 00:56:49.374165 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:56:49.374165 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 643/1290] 10.222.0.49 () {56 vars in 1117 bytes} [Sun Aug 21 00:56:49 2022] GET /identity/v3/services/placement => generated 90 bytes in 212 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:49.380863 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8debc-773d-4cfd-b705-3b7a9dbb9c24 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:49.488630 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71a8debc-773d-4cfd-b705-3b7a9dbb9c24 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:49.526379 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0ac6e600-6abf-43f8-8176-fa8386da198b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:49.527073 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6e600-6abf-43f8-8176-fa8386da198b None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:49.527437 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6e600-6abf-43f8-8176-fa8386da198b None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:49.527741 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0ac6e600-6abf-43f8-8176-fa8386da198b None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:49.528425 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6e600-6abf-43f8-8176-fa8386da198b None admin] RBAC: Adding query filter params (name=placement) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:49.528758 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6e600-6abf-43f8-8176-fa8386da198b None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:49.530250 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0ac6e600-6abf-43f8-8176-fa8386da198b None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:49.535815 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 648/1291] 10.222.0.49 () {56 vars in 1116 bytes} [Sun Aug 21 00:56:49 2022] GET /identity/v3/services?name=placement => generated 126 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:49.541948 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b4efe-0c3b-43c3-a787-eeaef3ed1439 None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:49.662459 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c28b4efe-0c3b-43c3-a787-eeaef3ed1439 None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:49.700690 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-84f3363b-e617-4102-b260-a675ea4b0364 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:49.701411 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3363b-e617-4102-b260-a675ea4b0364 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:49.701726 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3363b-e617-4102-b260-a675ea4b0364 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:49.702042 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-84f3363b-e617-4102-b260-a675ea4b0364 None admin] PATH_INFO: `/v3/services` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:49.702728 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3363b-e617-4102-b260-a675ea4b0364 None admin] RBAC: Adding query filter params (type=placement) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:49.703069 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3363b-e617-4102-b260-a675ea4b0364 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:49.704497 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-84f3363b-e617-4102-b260-a675ea4b0364 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:49.709784 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 644/1292] 10.222.0.49 () {56 vars in 1116 bytes} [Sun Aug 21 00:56:49 2022] GET /identity/v3/services?type=placement => generated 126 bytes in 168 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 00:56:51.733097 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391167a-9178-4279-ab0d-2bc71c0596ca None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:51.733653 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391167a-9178-4279-ab0d-2bc71c0596ca None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:51.733653 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c391167a-9178-4279-ab0d-2bc71c0596ca None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:51.734987 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 649/1293] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:56:51 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:51.741508 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d527136-f325-47d3-be09-7b461b0f2394 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:51.742034 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d527136-f325-47d3-be09-7b461b0f2394 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:51.742034 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d527136-f325-47d3-be09-7b461b0f2394 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:51.760938 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-6d527136-f325-47d3-be09-7b461b0f2394 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:51.762176 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6d527136-f325-47d3-be09-7b461b0f2394 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:51.800602 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:51.860386 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 645/1294] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:51 2022] POST /identity/v3/auth/tokens => generated 2118 bytes in 120 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:56:52.138573 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391167a-9178-4279-ab0d-2bc71c0596ca None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:52.187747 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:52.272199 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c391167a-9178-4279-ab0d-2bc71c0596ca None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:52.312980 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11641314-5bbb-4a7b-b36a-112adca4507b None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:52.313665 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11641314-5bbb-4a7b-b36a-112adca4507b None admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:52.313963 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11641314-5bbb-4a7b-b36a-112adca4507b None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:52.314202 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11641314-5bbb-4a7b-b36a-112adca4507b None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:52.314887 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11641314-5bbb-4a7b-b36a-112adca4507b None admin] RBAC: Authorizing `identity:create_service()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:52.316321 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11641314-5bbb-4a7b-b36a-112adca4507b None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:52.334301 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 650/1295] 10.222.0.49 () {60 vars in 1141 bytes} [Sun Aug 21 00:56:52 2022] POST /identity/v3/services => generated 246 bytes in 197 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:56:54.443994 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e4754-4205-4cf0-9546-965268735a78 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:54.444630 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e4754-4205-4cf0-9546-965268735a78 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:54.444759 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011e4754-4205-4cf0-9546-965268735a78 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:54.446601 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 646/1296] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:56:54 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:54.455512 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c9728-d975-49e6-9f6f-57703a265e42 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:54.456034 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c9728-d975-49e6-9f6f-57703a265e42 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:54.456462 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-859c9728-d975-49e6-9f6f-57703a265e42 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:54.485863 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-859c9728-d975-49e6-9f6f-57703a265e42 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:54.487851 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-859c9728-d975-49e6-9f6f-57703a265e42 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:54.617435 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 651/1297] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:54 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 164 msecs (HTTP/1.1 201) 6 headers in 364 bytes (1 switches on core 0) Aug 21 00:56:54.908270 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e4754-4205-4cf0-9546-965268735a78 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:55.014691 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011e4754-4205-4cf0-9546-965268735a78 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:55.053656 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dccb8-fb8a-47dc-8ded-8fc344bd704e None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:55.054291 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dccb8-fb8a-47dc-8ded-8fc344bd704e None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:55.054562 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dccb8-fb8a-47dc-8ded-8fc344bd704e None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:55.054822 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e5dccb8-fb8a-47dc-8ded-8fc344bd704e None admin] PATH_INFO: `/v3/services/placement` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:55.055414 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5dccb8-fb8a-47dc-8ded-8fc344bd704e None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:55.056981 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3e5dccb8-fb8a-47dc-8ded-8fc344bd704e None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:55.066815 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-3e5dccb8-fb8a-47dc-8ded-8fc344bd704e None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 00:56:55.066815 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:55.066815 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:56:55.066815 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:56:55.066815 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:56:55.066815 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:56:55.066815 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:56:55.066815 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:56:55.066815 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 00:56:55.066815 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:56:55.066815 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:56:55.066815 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:56:55.066815 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:55.066815 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:55.066815 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:55.066815 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:55.066815 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:55.068742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:55.068742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:55.068742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:55.068742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:55.068742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:55.068742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:55.068742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:56:55.068742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:56:55.068742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:56:55.068742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:56:55.068742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:55.068742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:55.068742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:55.068742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:55.068742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:55.068742 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:55.070570 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:55.070570 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:55.070570 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:55.070570 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:55.070570 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:55.070570 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:55.070570 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:55.070570 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:55.070570 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:55.070570 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:55.070570 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:56:55.070570 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:56:55.070570 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 00:56:55.070570 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:56:55.070570 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 647/1298] 10.222.0.49 () {56 vars in 1117 bytes} [Sun Aug 21 00:56:54 2022] GET /identity/v3/services/placement => generated 90 bytes in 161 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:55.077940 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c9728-d975-49e6-9f6f-57703a265e42 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:55.100967 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:55.231710 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-859c9728-d975-49e6-9f6f-57703a265e42 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:55.271560 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b16c3-560a-4b6c-a38f-c728ef058679 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:55.272157 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b16c3-560a-4b6c-a38f-c728ef058679 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:55.272443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b16c3-560a-4b6c-a38f-c728ef058679 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:55.272714 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b2b16c3-560a-4b6c-a38f-c728ef058679 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:55.273422 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b16c3-560a-4b6c-a38f-c728ef058679 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:55.273687 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b16c3-560a-4b6c-a38f-c728ef058679 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:55.275118 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1b2b16c3-560a-4b6c-a38f-c728ef058679 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:55.281120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 652/1299] 10.222.0.49 () {56 vars in 1116 bytes} [Sun Aug 21 00:56:55 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 204 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:55.287964 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dccb8-fb8a-47dc-8ded-8fc344bd704e None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:55.322723 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:55.397573 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e5dccb8-fb8a-47dc-8ded-8fc344bd704e None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:55.434318 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-92fb6387-c1cc-47a8-92b6-f192dc3d8a91 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:55.434915 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb6387-c1cc-47a8-92b6-f192dc3d8a91 None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:55.435186 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb6387-c1cc-47a8-92b6-f192dc3d8a91 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:55.435465 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-92fb6387-c1cc-47a8-92b6-f192dc3d8a91 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:55.436158 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb6387-c1cc-47a8-92b6-f192dc3d8a91 None admin] RBAC: Adding query filter params (interface=public, service_id=491e9397fc4d401d949dcbf3c137dc04, region_id=RegionOne) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:55.436474 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb6387-c1cc-47a8-92b6-f192dc3d8a91 None admin] RBAC: Authorizing `identity:list_endpoints()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:55.437877 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-92fb6387-c1cc-47a8-92b6-f192dc3d8a91 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:55.443541 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 648/1300] 10.222.0.49 () {56 vars in 1251 bytes} [Sun Aug 21 00:56:55 2022] GET /identity/v3/endpoints?service_id=491e9397fc4d401d949dcbf3c137dc04&interface=public®ion_id=RegionOne => generated 194 bytes in 156 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:55.452421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b16c3-560a-4b6c-a38f-c728ef058679 None admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:55.550873 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:55.570593 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b2b16c3-560a-4b6c-a38f-c728ef058679 None admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:55.607120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1fa34b-117c-41e8-801b-5e7ae5dfa1ba None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:55.607743 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fa34b-117c-41e8-801b-5e7ae5dfa1ba None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:55.608027 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fa34b-117c-41e8-801b-5e7ae5dfa1ba None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:55.608294 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1fa34b-117c-41e8-801b-5e7ae5dfa1ba None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:55.608911 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fa34b-117c-41e8-801b-5e7ae5dfa1ba None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:55.610362 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be1fa34b-117c-41e8-801b-5e7ae5dfa1ba None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:55.617867 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 653/1301] 10.222.0.49 () {56 vars in 1087 bytes} [Sun Aug 21 00:56:55 2022] GET /identity/v3/services => generated 2191 bytes in 166 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 00:56:57.577722 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40684ff-f081-4300-8b4c-d981c170094e None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:57.578522 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40684ff-f081-4300-8b4c-d981c170094e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:57.578522 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b40684ff-f081-4300-8b4c-d981c170094e None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:57.580004 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 649/1302] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:56:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:56:57.585728 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848053e3-83d1-43a8-806e-2704c8ed01f3 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:57.586277 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848053e3-83d1-43a8-806e-2704c8ed01f3 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:57.586277 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-848053e3-83d1-43a8-806e-2704c8ed01f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:57.604817 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-848053e3-83d1-43a8-806e-2704c8ed01f3 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:56:57.607200 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-848053e3-83d1-43a8-806e-2704c8ed01f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:56:57.676303 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 654/1303] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:56:57 2022] POST /identity/v3/auth/tokens => generated 2221 bytes in 92 msecs (HTTP/1.1 201) 6 headers in 364 bytes (2 switches on core 0) Aug 21 00:56:57.941602 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40684ff-f081-4300-8b4c-d981c170094e None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:58.036369 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:58.044824 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b40684ff-f081-4300-8b4c-d981c170094e None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:58.082936 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f9a29-ba3a-4b8b-b7e3-93cba960c64d None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:58.083736 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f9a29-ba3a-4b8b-b7e3-93cba960c64d None admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:58.084015 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f9a29-ba3a-4b8b-b7e3-93cba960c64d None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:58.084407 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e2f9a29-ba3a-4b8b-b7e3-93cba960c64d None admin] PATH_INFO: `/v3/services/placement` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:58.085101 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f9a29-ba3a-4b8b-b7e3-93cba960c64d None admin] RBAC: Authorizing `identity:get_service(service_id=placement)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:58.086767 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e2f9a29-ba3a-4b8b-b7e3-93cba960c64d None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:58.096523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application [None req-8e2f9a29-ba3a-4b8b-b7e3-93cba960c64d None admin] Could not find service: placement.: keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 00:56:58.096523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:58.096523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 152, in get_service Aug 21 00:56:58.096523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.driver.get_service(service_id) Aug 21 00:56:58.096523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 196, in get_service Aug 21 00:56:58.096523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(session, service_id).to_dict() Aug 21 00:56:58.096523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/backends/sql.py", line 191, in _get_service Aug 21 00:56:58.096523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:56:58.096523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 00:56:58.096523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:56:58.096523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application During handling of the above exception, another exception occurred: Aug 21 00:56:58.096523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:56:58.096523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Traceback (most recent call last): Aug 21 00:56:58.096523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1820, in full_dispatch_request Aug 21 00:56:58.096523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application rv = self.dispatch_request() Aug 21 00:56:58.096523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/app.py", line 1796, in dispatch_request Aug 21 00:56:58.096523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.ensure_sync(self.view_functions[rule.endpoint])(**view_args) Aug 21 00:56:58.098944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 467, in wrapper Aug 21 00:56:58.098944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = resource(*args, **kwargs) Aug 21 00:56:58.098944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask/views.py", line 107, in view Aug 21 00:56:58.098944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return current_app.ensure_sync(self.dispatch_request)(**kwargs) Aug 21 00:56:58.098944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/flask_restful/__init__.py", line 582, in dispatch_request Aug 21 00:56:58.098944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application resp = meth(*args, **kwargs) Aug 21 00:56:58.098944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 45, in get Aug 21 00:56:58.098944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._get_service(service_id) Aug 21 00:56:58.098944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/api/services.py", line 34, in _get_service Aug 21 00:56:58.098944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.wrap_member(PROVIDERS.catalog_api.get_service(service_id)) Aug 21 00:56:58.098944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/common/manager.py", line 115, in wrapped Aug 21 00:56:58.098944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application __ret_val = __f(*args, **kwargs) Aug 21 00:56:58.098944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/decorator.py", line 232, in fun Aug 21 00:56:58.098944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return caller(func, *(extras + args), **kw) Aug 21 00:56:58.098944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1577, in get_or_create_for_user_func Aug 21 00:56:58.098944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.get_or_create( Aug 21 00:56:58.100153 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 1042, in get_or_create Aug 21 00:56:58.100153 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application with Lock( Aug 21 00:56:58.100153 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 185, in __enter__ Aug 21 00:56:58.100153 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self._enter() Aug 21 00:56:58.100153 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 94, in _enter Aug 21 00:56:58.100153 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application generated = self._enter_create(value, createdtime) Aug 21 00:56:58.100153 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/lock.py", line 178, in _enter_create Aug 21 00:56:58.100153 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application return self.creator() Aug 21 00:56:58.100153 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/usr/local/lib/python3.8/dist-packages/dogpile/cache/region.py", line 995, in gen_value Aug 21 00:56:58.100153 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application created_value = creator( Aug 21 00:56:58.100153 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application File "/opt/stack/keystone/keystone/catalog/core.py", line 154, in get_service Aug 21 00:56:58.100153 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application raise exception.ServiceNotFound(service_id=service_id) Aug 21 00:56:58.100153 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application keystone.exception.ServiceNotFound: Could not find service: placement. Aug 21 00:56:58.100153 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: ERROR keystone.server.flask.application Aug 21 00:56:58.100153 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 650/1304] 10.222.0.49 () {56 vars in 1117 bytes} [Sun Aug 21 00:56:57 2022] GET /identity/v3/services/placement => generated 90 bytes in 157 msecs (HTTP/1.1 404) 5 headers in 183 bytes (1 switches on core 0) Aug 21 00:56:58.104054 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848053e3-83d1-43a8-806e-2704c8ed01f3 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:58.188943 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:56:58.215091 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-848053e3-83d1-43a8-806e-2704c8ed01f3 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:58.252478 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3d9a667-0ed4-4d63-8a01-235aede23302 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:58.253115 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9a667-0ed4-4d63-8a01-235aede23302 None admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:58.253398 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9a667-0ed4-4d63-8a01-235aede23302 None admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:58.253666 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3d9a667-0ed4-4d63-8a01-235aede23302 None admin] PATH_INFO: `/v3/services` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:58.254308 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9a667-0ed4-4d63-8a01-235aede23302 None admin] RBAC: Adding query filter params (name=placement) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 00:56:58.254610 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9a667-0ed4-4d63-8a01-235aede23302 None admin] RBAC: Authorizing `identity:list_services()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:58.255997 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3d9a667-0ed4-4d63-8a01-235aede23302 None admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:58.261606 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 655/1305] 10.222.0.49 () {56 vars in 1116 bytes} [Sun Aug 21 00:56:58 2022] GET /identity/v3/services?name=placement => generated 358 bytes in 158 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 00:56:58.267584 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f9a29-ba3a-4b8b-b7e3-93cba960c64d None admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:56:58.376776 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e2f9a29-ba3a-4b8b-b7e3-93cba960c64d None admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:56:58.413654 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a29d39f7-4946-42a6-a063-7995325f9f79 None admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': 'all', 'project_id': None, 'project_domain_id': None, 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:56:58.414260 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d39f7-4946-42a6-a063-7995325f9f79 None admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:56:58.414531 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d39f7-4946-42a6-a063-7995325f9f79 None admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:56:58.414794 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a29d39f7-4946-42a6-a063-7995325f9f79 None admin] PATH_INFO: `/v3/endpoints` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:56:58.415455 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d39f7-4946-42a6-a063-7995325f9f79 None admin] RBAC: Authorizing `identity:create_endpoint()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:56:58.416904 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a29d39f7-4946-42a6-a063-7995325f9f79 None admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:56:58.439866 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 651/1306] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 21 00:56:58 2022] POST /identity/v3/endpoints => generated 331 bytes in 173 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 00:57:08.258401 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=30 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:57:08.435810 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=91,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:11.200130 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d48f3-98bb-4354-ba1e-38e61ca5f548 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:11.200996 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d48f3-98bb-4354-ba1e-38e61ca5f548 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:11.200996 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44d48f3-98bb-4354-ba1e-38e61ca5f548 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:11.202490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 656/1307] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:58:11 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:11.209404 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66212b17-0c30-46ee-85b6-16d186012c08 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:11.210223 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66212b17-0c30-46ee-85b6-16d186012c08 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:11.210419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66212b17-0c30-46ee-85b6-16d186012c08 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:11.384805 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-66212b17-0c30-46ee-85b6-16d186012c08 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:11.388084 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-66212b17-0c30-46ee-85b6-16d186012c08 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:11.625990 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 652/1308] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:58:11 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:11.938054 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61df45-2443-4062-a95a-ee4de5e547fb None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:11.939854 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61df45-2443-4062-a95a-ee4de5e547fb None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:11.940320 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c61df45-2443-4062-a95a-ee4de5e547fb None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:11.942297 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 657/1309] 10.222.0.49 () {54 vars in 965 bytes} [Sun Aug 21 00:58:11 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:11.949594 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899012f-6b88-4eee-b317-1831534a4636 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:11.950142 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899012f-6b88-4eee-b317-1831534a4636 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:11.950587 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b899012f-6b88-4eee-b317-1831534a4636 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:12.043959 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-b899012f-6b88-4eee-b317-1831534a4636 None None] MFA Rules not processed for user `78c29816db2d4193b293a0f94b4d1a01`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:12.045461 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b899012f-6b88-4eee-b317-1831534a4636 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:12.068740 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:12.134489 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 653/1310] 10.222.0.49 () {58 vars in 1062 bytes} [Sun Aug 21 00:58:11 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:12.143988 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61df45-2443-4062-a95a-ee4de5e547fb None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:12.146161 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7c61df45-2443-4062-a95a-ee4de5e547fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:12.273845 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c61df45-2443-4062-a95a-ee4de5e547fb None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:12.425442 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96e6ad85-ef6f-4042-9b00-33a8b5982629 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:12.426827 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6ad85-ef6f-4042-9b00-33a8b5982629 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:12.427525 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6ad85-ef6f-4042-9b00-33a8b5982629 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:12.428185 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96e6ad85-ef6f-4042-9b00-33a8b5982629 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:12.431316 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-96e6ad85-ef6f-4042-9b00-33a8b5982629 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:12.533487 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:12.637085 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e6ad85-ef6f-4042-9b00-33a8b5982629 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:12.639536 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96e6ad85-ef6f-4042-9b00-33a8b5982629 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:12.676470 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 658/1311] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 533 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:15.847105 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909e943-24fb-4349-bd2b-e8cbc557a31b None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:15.847845 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909e943-24fb-4349-bd2b-e8cbc557a31b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:15.847845 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f909e943-24fb-4349-bd2b-e8cbc557a31b None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:15.849155 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 654/1312] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:58:15 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:15.855750 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06f45b-c6a4-43c1-b21b-e9e14f07f955 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:15.856615 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06f45b-c6a4-43c1-b21b-e9e14f07f955 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:15.856778 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df06f45b-c6a4-43c1-b21b-e9e14f07f955 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:15.963848 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-df06f45b-c6a4-43c1-b21b-e9e14f07f955 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:15.966131 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-df06f45b-c6a4-43c1-b21b-e9e14f07f955 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:16.153478 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 659/1313] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:58:15 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 299 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:16.680649 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909e943-24fb-4349-bd2b-e8cbc557a31b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:16.682618 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f909e943-24fb-4349-bd2b-e8cbc557a31b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:16.807629 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f909e943-24fb-4349-bd2b-e8cbc557a31b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:16.886089 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:16.889440 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66cd0c64-84fb-4add-b356-0b0355bd5397 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:16.890154 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd0c64-84fb-4add-b356-0b0355bd5397 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:16.890776 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd0c64-84fb-4add-b356-0b0355bd5397 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:16.891181 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66cd0c64-84fb-4add-b356-0b0355bd5397 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:16.893424 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-66cd0c64-84fb-4add-b356-0b0355bd5397 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:17.065721 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd0c64-84fb-4add-b356-0b0355bd5397 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:17.068508 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66cd0c64-84fb-4add-b356-0b0355bd5397 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:17.106123 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 655/1314] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:16 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 426 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:19.482875 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af982b-114c-4c50-8c5a-111468f95946 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:19.483406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af982b-114c-4c50-8c5a-111468f95946 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:19.483406 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81af982b-114c-4c50-8c5a-111468f95946 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:19.484691 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 660/1315] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:19.490832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cf312-bbd5-42ff-bf2b-4394639ad3ce None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:19.491330 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cf312-bbd5-42ff-bf2b-4394639ad3ce None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:19.491467 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-346cf312-bbd5-42ff-bf2b-4394639ad3ce None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:19.575111 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-346cf312-bbd5-42ff-bf2b-4394639ad3ce None None] MFA Rules not processed for user `5964ab09eab9453db0a9316d1da8e974`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:19.576416 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-346cf312-bbd5-42ff-bf2b-4394639ad3ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:19.636185 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:19.683694 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 656/1316] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:58:19 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 194 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 00:58:19.984214 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab1325-5c7a-4151-a3b1-0b113d4ab072 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:19.984475 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab1325-5c7a-4151-a3b1-0b113d4ab072 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:19.984773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9ab1325-5c7a-4151-a3b1-0b113d4ab072 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:19.986193 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 661/1317] 10.222.0.49 () {54 vars in 965 bytes} [Sun Aug 21 00:58:19 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:19.992831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fbb62-b4fe-4701-b569-7737d580105e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:19.993145 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fbb62-b4fe-4701-b569-7737d580105e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:19.993423 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fa9fbb62-b4fe-4701-b569-7737d580105e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:20.079399 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-fa9fbb62-b4fe-4701-b569-7737d580105e None None] MFA Rules not processed for user `78c29816db2d4193b293a0f94b4d1a01`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:20.080658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-fa9fbb62-b4fe-4701-b569-7737d580105e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:20.161725 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 657/1318] 10.222.0.49 () {58 vars in 1062 bytes} [Sun Aug 21 00:58:19 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 170 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:20.171171 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab1325-5c7a-4151-a3b1-0b113d4ab072 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:20.172732 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a9ab1325-5c7a-4151-a3b1-0b113d4ab072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:20.183083 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:20.286231 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a9ab1325-5c7a-4151-a3b1-0b113d4ab072 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:20.365111 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e313e821-9990-495c-858a-b0192fe6876b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:20.365751 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313e821-9990-495c-858a-b0192fe6876b service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:20.366030 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313e821-9990-495c-858a-b0192fe6876b service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:20.366303 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e313e821-9990-495c-858a-b0192fe6876b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:20.367964 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-e313e821-9990-495c-858a-b0192fe6876b service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:20.441407 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:20.493532 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313e821-9990-495c-858a-b0192fe6876b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:20.494896 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e313e821-9990-495c-858a-b0192fe6876b service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:20.515009 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 662/1319] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:20 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 344 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:23.422538 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5205f7-0280-44a3-902b-6e2975521a54 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:23.423092 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5205f7-0280-44a3-902b-6e2975521a54 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:23.423092 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c5205f7-0280-44a3-902b-6e2975521a54 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:23.424445 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 658/1320] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:58:23 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:23.430567 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf831a-31c1-4714-8322-1cfa672f8656 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:23.431016 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf831a-31c1-4714-8322-1cfa672f8656 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:23.431109 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74cf831a-31c1-4714-8322-1cfa672f8656 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:23.510089 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-74cf831a-31c1-4714-8322-1cfa672f8656 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:23.511205 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-74cf831a-31c1-4714-8322-1cfa672f8656 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:23.615507 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 663/1321] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:58:23 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 186 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:23.896626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5205f7-0280-44a3-902b-6e2975521a54 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:23.898274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5c5205f7-0280-44a3-902b-6e2975521a54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:23.951452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:24.011151 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c5205f7-0280-44a3-902b-6e2975521a54 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:24.086823 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353e4616-f320-4eb2-8553-5036edf83e85 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:24.087444 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e4616-f320-4eb2-8553-5036edf83e85 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:24.087719 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e4616-f320-4eb2-8553-5036edf83e85 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:24.087968 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353e4616-f320-4eb2-8553-5036edf83e85 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:24.089662 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-353e4616-f320-4eb2-8553-5036edf83e85 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:24.190688 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:24.204859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e4616-f320-4eb2-8553-5036edf83e85 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:24.206334 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353e4616-f320-4eb2-8553-5036edf83e85 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:24.224895 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 659/1322] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:23 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 329 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:26.931206 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b89ea-b762-4b7d-a341-96b58011a4dc None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:26.931812 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b89ea-b762-4b7d-a341-96b58011a4dc None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:26.931812 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3c1b89ea-b762-4b7d-a341-96b58011a4dc None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:26.933118 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 664/1323] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:58:26 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:26.938912 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa52a61-9a37-4cbf-8ccc-b6b295f89d38 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:26.939583 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa52a61-9a37-4cbf-8ccc-b6b295f89d38 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:26.939583 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7fa52a61-9a37-4cbf-8ccc-b6b295f89d38 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:27.013987 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-7fa52a61-9a37-4cbf-8ccc-b6b295f89d38 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:27.015201 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7fa52a61-9a37-4cbf-8ccc-b6b295f89d38 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:27.127104 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 660/1324] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:58:26 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 189 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:27.406298 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b89ea-b762-4b7d-a341-96b58011a4dc None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:27.407833 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-3c1b89ea-b762-4b7d-a341-96b58011a4dc None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:27.429813 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:27.537909 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3c1b89ea-b762-4b7d-a341-96b58011a4dc None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:27.619736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5724e52a-d332-42f9-8d6b-083090b682ed service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:27.620368 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724e52a-d332-42f9-8d6b-083090b682ed service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:27.620646 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724e52a-d332-42f9-8d6b-083090b682ed service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:27.620904 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5724e52a-d332-42f9-8d6b-083090b682ed service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:27.622953 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5724e52a-d332-42f9-8d6b-083090b682ed service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:27.710645 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:27.752989 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724e52a-d332-42f9-8d6b-083090b682ed service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:27.754617 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5724e52a-d332-42f9-8d6b-083090b682ed service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:27.777411 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 665/1325] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 372 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:29.848239 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b777341-d763-4eb4-a849-621e4891fa8f None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:29.849169 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b777341-d763-4eb4-a849-621e4891fa8f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:29.849169 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2b777341-d763-4eb4-a849-621e4891fa8f None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:29.850986 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 661/1326] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:58:29 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:29.859128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49be227-0eec-4b03-914b-698c4ddcf3d0 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:29.860104 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49be227-0eec-4b03-914b-698c4ddcf3d0 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:29.860104 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c49be227-0eec-4b03-914b-698c4ddcf3d0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:29.948128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-c49be227-0eec-4b03-914b-698c4ddcf3d0 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:29.948805 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c49be227-0eec-4b03-914b-698c4ddcf3d0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:30.059568 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 666/1327] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:58:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:30.342649 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b777341-d763-4eb4-a849-621e4891fa8f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:30.344495 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2b777341-d763-4eb4-a849-621e4891fa8f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:30.414796 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:30.462120 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2b777341-d763-4eb4-a849-621e4891fa8f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:30.557394 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7416f3d-6404-4e14-868c-c08e55eedd26 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:30.558385 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7416f3d-6404-4e14-868c-c08e55eedd26 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:30.558785 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7416f3d-6404-4e14-868c-c08e55eedd26 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:30.559156 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7416f3d-6404-4e14-868c-c08e55eedd26 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:30.560924 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f7416f3d-6404-4e14-868c-c08e55eedd26 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:30.679900 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:30.682896 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7416f3d-6404-4e14-868c-c08e55eedd26 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:30.684426 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7416f3d-6404-4e14-868c-c08e55eedd26 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:30.705119 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 662/1328] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:30 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:32.702088 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803391a-314c-478a-82ff-a7486f5b4b13 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:32.702668 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803391a-314c-478a-82ff-a7486f5b4b13 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:32.702668 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d803391a-314c-478a-82ff-a7486f5b4b13 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:32.704060 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 667/1329] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:58:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:32.710627 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915eb7b-21b4-45a2-9b9a-81a28e9805b2 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:32.711162 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915eb7b-21b4-45a2-9b9a-81a28e9805b2 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:32.711463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9915eb7b-21b4-45a2-9b9a-81a28e9805b2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:32.790589 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-9915eb7b-21b4-45a2-9b9a-81a28e9805b2 None None] MFA Rules not processed for user `5964ab09eab9453db0a9316d1da8e974`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:32.791911 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9915eb7b-21b4-45a2-9b9a-81a28e9805b2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:32.943178 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 663/1330] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:58:32 2022] POST /identity/v3/auth/tokens => generated 3243 bytes in 234 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:33.378803 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803391a-314c-478a-82ff-a7486f5b4b13 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:33.380523 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d803391a-314c-478a-82ff-a7486f5b4b13 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:33.422363 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:33.526430 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d803391a-314c-478a-82ff-a7486f5b4b13 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:33.638459 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-33174758-c8cc-44c8-b607-27f434caca1c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:33.640089 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33174758-c8cc-44c8-b607-27f434caca1c service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:33.640648 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33174758-c8cc-44c8-b607-27f434caca1c service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:33.640947 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-33174758-c8cc-44c8-b607-27f434caca1c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:33.642989 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-33174758-c8cc-44c8-b607-27f434caca1c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:33.739772 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:33.779152 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33174758-c8cc-44c8-b607-27f434caca1c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:33.780652 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-33174758-c8cc-44c8-b607-27f434caca1c service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:33.810075 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 668/1331] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:33 2022] GET /identity/v3/auth/tokens => generated 3243 bytes in 432 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:36.038926 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae52b1-525a-4a6e-8e2a-6dd115e32ae2 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:36.039528 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae52b1-525a-4a6e-8e2a-6dd115e32ae2 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:36.039528 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b1ae52b1-525a-4a6e-8e2a-6dd115e32ae2 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:36.040871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 664/1332] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:58:36 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:36.046884 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6280b87-1c21-43c8-b55c-0c0698cae072 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:36.047387 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6280b87-1c21-43c8-b55c-0c0698cae072 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:36.047538 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6280b87-1c21-43c8-b55c-0c0698cae072 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:36.130361 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-a6280b87-1c21-43c8-b55c-0c0698cae072 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:36.131648 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a6280b87-1c21-43c8-b55c-0c0698cae072 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:36.250213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 669/1333] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:58:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 204 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:36.538593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae52b1-525a-4a6e-8e2a-6dd115e32ae2 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:36.540136 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b1ae52b1-525a-4a6e-8e2a-6dd115e32ae2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:36.627073 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:36.668407 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b1ae52b1-525a-4a6e-8e2a-6dd115e32ae2 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:36.749859 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3075c632-9900-4d10-9cdc-52e5adcbc63e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:36.750476 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075c632-9900-4d10-9cdc-52e5adcbc63e service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:36.750745 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075c632-9900-4d10-9cdc-52e5adcbc63e service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:36.751011 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3075c632-9900-4d10-9cdc-52e5adcbc63e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:36.752748 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3075c632-9900-4d10-9cdc-52e5adcbc63e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:36.878258 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075c632-9900-4d10-9cdc-52e5adcbc63e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:36.879609 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3075c632-9900-4d10-9cdc-52e5adcbc63e service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:36.890566 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:36.900490 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 665/1334] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 363 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:38.888935 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3412cbc-57b6-4363-ba2b-400e1463a7c9 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:38.889697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3412cbc-57b6-4363-ba2b-400e1463a7c9 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:38.889697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3412cbc-57b6-4363-ba2b-400e1463a7c9 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:38.890919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 670/1335] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:58:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:38.897107 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841702d1-d6fe-4af7-8679-4a5651221f19 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:38.897821 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841702d1-d6fe-4af7-8679-4a5651221f19 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:38.897821 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-841702d1-d6fe-4af7-8679-4a5651221f19 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:38.972589 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-841702d1-d6fe-4af7-8679-4a5651221f19 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:38.973854 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-841702d1-d6fe-4af7-8679-4a5651221f19 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:39.086641 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 666/1336] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:58:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:39.374222 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3412cbc-57b6-4363-ba2b-400e1463a7c9 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:39.375870 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b3412cbc-57b6-4363-ba2b-400e1463a7c9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:39.434858 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:39.514386 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3412cbc-57b6-4363-ba2b-400e1463a7c9 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:39.600987 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-79757c36-c5da-4eac-9e6a-7cdc72b62320 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:39.601633 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79757c36-c5da-4eac-9e6a-7cdc72b62320 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:39.601919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79757c36-c5da-4eac-9e6a-7cdc72b62320 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:39.602189 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79757c36-c5da-4eac-9e6a-7cdc72b62320 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:39.603843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-79757c36-c5da-4eac-9e6a-7cdc72b62320 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:39.704718 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:39.733732 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79757c36-c5da-4eac-9e6a-7cdc72b62320 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:39.735215 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-79757c36-c5da-4eac-9e6a-7cdc72b62320 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:39.758389 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 671/1337] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 385 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:42.203509 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f6ddd-c6c5-409e-a4e2-ae6e6040255d None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:42.204144 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f6ddd-c6c5-409e-a4e2-ae6e6040255d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:42.204144 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-169f6ddd-c6c5-409e-a4e2-ae6e6040255d None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:42.205467 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 667/1338] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:58:42 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:42.211247 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0d6b4-2ddb-4e91-bf14-1e434af3f708 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:42.211767 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0d6b4-2ddb-4e91-bf14-1e434af3f708 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:42.213284 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ce0d6b4-2ddb-4e91-bf14-1e434af3f708 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:42.287052 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-8ce0d6b4-2ddb-4e91-bf14-1e434af3f708 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:42.288338 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-8ce0d6b4-2ddb-4e91-bf14-1e434af3f708 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:42.397213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 672/1339] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:58:42 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:42.686230 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f6ddd-c6c5-409e-a4e2-ae6e6040255d None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:42.687779 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-169f6ddd-c6c5-409e-a4e2-ae6e6040255d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:42.770219 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:42.800948 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-169f6ddd-c6c5-409e-a4e2-ae6e6040255d None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:42.889077 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cd885a1e-57e3-437d-94c1-4f745fd5021e service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:42.889700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd885a1e-57e3-437d-94c1-4f745fd5021e service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:42.889978 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd885a1e-57e3-437d-94c1-4f745fd5021e service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:42.890243 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cd885a1e-57e3-437d-94c1-4f745fd5021e service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:42.891886 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-cd885a1e-57e3-437d-94c1-4f745fd5021e service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:43.017694 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd885a1e-57e3-437d-94c1-4f745fd5021e service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:43.019140 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cd885a1e-57e3-437d-94c1-4f745fd5021e service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:43.037484 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 668/1340] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:42 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 352 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:47.190630 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd4662-ae26-4943-9481-30a4f1eb85bd None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:47.191418 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd4662-ae26-4943-9481-30a4f1eb85bd None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:47.191418 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3dbd4662-ae26-4943-9481-30a4f1eb85bd None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:47.192814 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 673/1341] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:58:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:47.202315 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2be23-7a70-469b-a82a-ae23b5ce7933 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:47.202981 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2be23-7a70-469b-a82a-ae23b5ce7933 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:47.203307 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4d2be23-7a70-469b-a82a-ae23b5ce7933 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:47.216152 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:47.300115 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-f4d2be23-7a70-469b-a82a-ae23b5ce7933 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:47.301467 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f4d2be23-7a70-469b-a82a-ae23b5ce7933 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:47.432949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 669/1342] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:58:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 233 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:47.735563 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd4662-ae26-4943-9481-30a4f1eb85bd None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:47.737260 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-3dbd4662-ae26-4943-9481-30a4f1eb85bd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:47.813344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:47.880978 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3dbd4662-ae26-4943-9481-30a4f1eb85bd None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:47.999321 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1db3767a-d0c3-483c-b724-d79faa00783d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:47.999866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3767a-d0c3-483c-b724-d79faa00783d service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:48.000248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3767a-d0c3-483c-b724-d79faa00783d service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:48.000545 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1db3767a-d0c3-483c-b724-d79faa00783d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:48.002498 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-1db3767a-d0c3-483c-b724-d79faa00783d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:48.155983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:48.177635 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3767a-d0c3-483c-b724-d79faa00783d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:48.179197 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1db3767a-d0c3-483c-b724-d79faa00783d service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:48.200221 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 674/1343] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:50.931807 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e4d05-296e-4731-8a7b-2a49caab27a9 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:50.932448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e4d05-296e-4731-8a7b-2a49caab27a9 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:50.932448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e6e4d05-296e-4731-8a7b-2a49caab27a9 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:50.933868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 670/1344] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:58:50 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:50.940250 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15032f82-2b89-41ee-b59d-cf6232b97600 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:50.940931 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15032f82-2b89-41ee-b59d-cf6232b97600 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:50.940931 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-15032f82-2b89-41ee-b59d-cf6232b97600 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:51.025361 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-15032f82-2b89-41ee-b59d-cf6232b97600 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:51.027220 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-15032f82-2b89-41ee-b59d-cf6232b97600 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:51.154348 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 675/1345] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:58:50 2022] POST /identity/v3/auth/tokens => generated 3238 bytes in 215 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:51.438857 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e4d05-296e-4731-8a7b-2a49caab27a9 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:51.440416 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2e6e4d05-296e-4731-8a7b-2a49caab27a9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:51.553354 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:51.572625 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e6e4d05-296e-4731-8a7b-2a49caab27a9 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:51.691398 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9a3ac909-052f-470f-83bd-06097b660352 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:51.692253 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ac909-052f-470f-83bd-06097b660352 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:51.692729 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ac909-052f-470f-83bd-06097b660352 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:51.693246 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9a3ac909-052f-470f-83bd-06097b660352 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:51.696324 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9a3ac909-052f-470f-83bd-06097b660352 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:51.843924 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ac909-052f-470f-83bd-06097b660352 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:51.845602 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9a3ac909-052f-470f-83bd-06097b660352 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:51.867602 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 671/1346] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:51 2022] GET /identity/v3/auth/tokens => generated 3238 bytes in 429 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:58:57.043890 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038bba4-687e-45a2-a4f5-28db71d4fb59 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:57.044563 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038bba4-687e-45a2-a4f5-28db71d4fb59 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:57.044563 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5038bba4-687e-45a2-a4f5-28db71d4fb59 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:57.045891 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 676/1347] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:58:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:58:57.052028 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78760b-d143-4ad1-9041-9101cf262e8c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:57.052634 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78760b-d143-4ad1-9041-9101cf262e8c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:57.052634 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5a78760b-d143-4ad1-9041-9101cf262e8c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:57.085536 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:57.168402 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-5a78760b-d143-4ad1-9041-9101cf262e8c None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:58:57.169996 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5a78760b-d143-4ad1-9041-9101cf262e8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:57.323346 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 672/1348] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:58:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 272 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:58:57.738076 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038bba4-687e-45a2-a4f5-28db71d4fb59 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:58:57.740157 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5038bba4-687e-45a2-a4f5-28db71d4fb59 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:57.859576 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:57.938345 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5038bba4-687e-45a2-a4f5-28db71d4fb59 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:58:58.098140 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c4495bb3-105a-42d6-8466-37c0f8c3f3f2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:58:58.099345 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4495bb3-105a-42d6-8466-37c0f8c3f3f2 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:58:58.099899 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4495bb3-105a-42d6-8466-37c0f8c3f3f2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:58:58.100376 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4495bb3-105a-42d6-8466-37c0f8c3f3f2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:58:58.103559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c4495bb3-105a-42d6-8466-37c0f8c3f3f2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:58:58.285141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:58:58.291804 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4495bb3-105a-42d6-8466-37c0f8c3f3f2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:58:58.295096 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c4495bb3-105a-42d6-8466-37c0f8c3f3f2 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:58:58.329629 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 677/1349] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 00:58:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 593 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 00:59:05.472947 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad7263-591c-476e-b926-ef49e56afccd None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:05.472947 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad7263-591c-476e-b926-ef49e56afccd None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:05.476443 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02ad7263-591c-476e-b926-ef49e56afccd None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:05.479772 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 673/1350] 10.222.0.49 () {54 vars in 921 bytes} [Sun Aug 21 00:59:05 2022] GET /identity => generated 270 bytes in 12 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:05.490275 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f9055-4eb4-4df9-95df-9cd22b3ca8cf None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:05.491087 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f9055-4eb4-4df9-95df-9cd22b3ca8cf None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:05.491253 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78f9055-4eb4-4df9-95df-9cd22b3ca8cf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:05.718481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-b78f9055-4eb4-4df9-95df-9cd22b3ca8cf None None] MFA Rules not processed for user `3a225f81f16e4cf2a1e62bbb3ec8eee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:05.720250 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b78f9055-4eb4-4df9-95df-9cd22b3ca8cf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:05.972843 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 678/1351] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 21 00:59:05 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 484 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:07.322119 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=59 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:13.193412 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519a03e-7246-4eb7-8cae-231957edc760 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:13.194274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519a03e-7246-4eb7-8cae-231957edc760 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:13.194274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8519a03e-7246-4eb7-8cae-231957edc760 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:13.195784 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 674/1352] 10.222.0.49 () {54 vars in 921 bytes} [Sun Aug 21 00:59:13 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:59:13.202231 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5e2f7-6e36-4b0b-ad88-dfc3b9a5db70 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:13.202945 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5e2f7-6e36-4b0b-ad88-dfc3b9a5db70 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:13.202945 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3bb5e2f7-6e36-4b0b-ad88-dfc3b9a5db70 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:13.304375 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:13.343401 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-3bb5e2f7-6e36-4b0b-ad88-dfc3b9a5db70 None None] MFA Rules not processed for user `3a225f81f16e4cf2a1e62bbb3ec8eee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:13.346320 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-3bb5e2f7-6e36-4b0b-ad88-dfc3b9a5db70 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:13.582720 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 679/1353] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 21 00:59:13 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 381 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:15.399029 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f1198-ea9a-4aca-ab72-42cfacddaf44 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:15.399531 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f1198-ea9a-4aca-ab72-42cfacddaf44 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:15.400023 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-710f1198-ea9a-4aca-ab72-42cfacddaf44 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:15.402667 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 675/1354] 10.222.0.49 () {54 vars in 921 bytes} [Sun Aug 21 00:59:15 2022] GET /identity => generated 270 bytes in 9 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:15.411397 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62872457-f4eb-4b63-8306-6192bd093cdf None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:15.412528 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62872457-f4eb-4b63-8306-6192bd093cdf None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:15.412528 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62872457-f4eb-4b63-8306-6192bd093cdf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:15.556050 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-62872457-f4eb-4b63-8306-6192bd093cdf None None] MFA Rules not processed for user `3a225f81f16e4cf2a1e62bbb3ec8eee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:15.558397 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-62872457-f4eb-4b63-8306-6192bd093cdf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:15.634707 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:15.751705 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 680/1355] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 21 00:59:15 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 341 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:19.722355 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e902a9-6a73-48d1-9254-b97ba2252b68 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:19.723036 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e902a9-6a73-48d1-9254-b97ba2252b68 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:19.723036 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-75e902a9-6a73-48d1-9254-b97ba2252b68 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:19.725574 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 676/1356] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:59:19 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:19.733282 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a473d1-b73b-4663-a828-d0ed59f768f9 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:19.733282 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a473d1-b73b-4663-a828-d0ed59f768f9 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:19.734110 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91a473d1-b73b-4663-a828-d0ed59f768f9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:19.850673 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-91a473d1-b73b-4663-a828-d0ed59f768f9 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:19.852156 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-91a473d1-b73b-4663-a828-d0ed59f768f9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:20.028770 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 681/1357] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:19 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 297 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:20.608255 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85151b7e-d27b-4332-9380-b53ee436907f None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:20.608583 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85151b7e-d27b-4332-9380-b53ee436907f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:20.608777 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85151b7e-d27b-4332-9380-b53ee436907f None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:20.610179 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 677/1358] 10.222.0.49 () {54 vars in 962 bytes} [Sun Aug 21 00:59:20 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:59:20.627382 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f165f5-6c46-419a-8706-854409eb914e None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:20.628077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f165f5-6c46-419a-8706-854409eb914e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:20.628624 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46f165f5-6c46-419a-8706-854409eb914e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:20.673481 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:20.795816 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-46f165f5-6c46-419a-8706-854409eb914e None None] MFA Rules not processed for user `6b003ae4a082485ab608bf84c1657159`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:20.799030 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-46f165f5-6c46-419a-8706-854409eb914e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:21.041237 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 682/1359] 10.222.0.49 () {58 vars in 1059 bytes} [Sun Aug 21 00:59:20 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 418 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:21.051669 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85151b7e-d27b-4332-9380-b53ee436907f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:21.054486 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-85151b7e-d27b-4332-9380-b53ee436907f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:21.299304 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85151b7e-d27b-4332-9380-b53ee436907f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:21.412327 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:21.503227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-31e8b96b-f1f2-4068-adcd-00237bd8bfc5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:21.505820 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8b96b-f1f2-4068-adcd-00237bd8bfc5 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:21.506646 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8b96b-f1f2-4068-adcd-00237bd8bfc5 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:21.507549 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31e8b96b-f1f2-4068-adcd-00237bd8bfc5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:21.511996 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-31e8b96b-f1f2-4068-adcd-00237bd8bfc5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:21.676614 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8b96b-f1f2-4068-adcd-00237bd8bfc5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:21.679933 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-31e8b96b-f1f2-4068-adcd-00237bd8bfc5 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:21.721135 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 678/1360] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 00:59:21 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 671 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:59:24.880002 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca55bf7-698f-444d-abee-e9786c0b785c None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:24.880889 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca55bf7-698f-444d-abee-e9786c0b785c None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:24.881761 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dca55bf7-698f-444d-abee-e9786c0b785c None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:24.884471 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 683/1361] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:59:24 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:24.894832 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ad3f6-1e5c-4449-af2b-ba19623bc0d1 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:24.897140 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ad3f6-1e5c-4449-af2b-ba19623bc0d1 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:24.897140 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ad3f6-1e5c-4449-af2b-ba19623bc0d1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:25.012635 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-895ad3f6-1e5c-4449-af2b-ba19623bc0d1 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:25.014185 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-895ad3f6-1e5c-4449-af2b-ba19623bc0d1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:25.095218 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:25.249649 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 679/1362] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:24 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 358 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:25.695801 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca55bf7-698f-444d-abee-e9786c0b785c None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:25.699251 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-dca55bf7-698f-444d-abee-e9786c0b785c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:25.818022 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:25.979776 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dca55bf7-698f-444d-abee-e9786c0b785c None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:26.155041 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-100254a5-ff3f-4206-8131-160f45b2e4f0 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:26.155810 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100254a5-ff3f-4206-8131-160f45b2e4f0 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:26.156235 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100254a5-ff3f-4206-8131-160f45b2e4f0 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:26.156535 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-100254a5-ff3f-4206-8131-160f45b2e4f0 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:26.158894 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-100254a5-ff3f-4206-8131-160f45b2e4f0 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:26.197813 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:26.304635 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100254a5-ff3f-4206-8131-160f45b2e4f0 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:26.307476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-100254a5-ff3f-4206-8131-160f45b2e4f0 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:26.344063 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 684/1363] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 00:59:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 650 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:59:29.945931 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eff557-0a2f-4826-a94c-d02574c8d032 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:29.947047 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eff557-0a2f-4826-a94c-d02574c8d032 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:29.947831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31eff557-0a2f-4826-a94c-d02574c8d032 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:29.953129 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 680/1364] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:59:29 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:29.966476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5534af-7d75-4593-99bf-3e98e6f386b5 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:29.967498 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5534af-7d75-4593-99bf-3e98e6f386b5 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:29.968317 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a5534af-7d75-4593-99bf-3e98e6f386b5 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:30.106246 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-1a5534af-7d75-4593-99bf-3e98e6f386b5 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:30.108043 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-1a5534af-7d75-4593-99bf-3e98e6f386b5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:30.324040 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:30.341077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 685/1365] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:29 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:30.762762 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ac805-7dc6-4a87-9acc-2cf0c5c957b7 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:30.763100 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ac805-7dc6-4a87-9acc-2cf0c5c957b7 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:30.763403 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-492ac805-7dc6-4a87-9acc-2cf0c5c957b7 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:30.765253 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 681/1366] 10.222.0.49 () {54 vars in 962 bytes} [Sun Aug 21 00:59:30 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:30.773761 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc2b8d-1b45-4e9d-9566-edd34e5d6320 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:30.774337 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc2b8d-1b45-4e9d-9566-edd34e5d6320 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:30.774791 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a9cc2b8d-1b45-4e9d-9566-edd34e5d6320 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:30.909008 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-a9cc2b8d-1b45-4e9d-9566-edd34e5d6320 None None] MFA Rules not processed for user `6b003ae4a082485ab608bf84c1657159`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:30.911165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a9cc2b8d-1b45-4e9d-9566-edd34e5d6320 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:31.160780 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 686/1367] 10.222.0.49 () {58 vars in 1059 bytes} [Sun Aug 21 00:59:30 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 387 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:31.174796 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ac805-7dc6-4a87-9acc-2cf0c5c957b7 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:31.179701 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-492ac805-7dc6-4a87-9acc-2cf0c5c957b7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:31.391491 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188f67a-f1e8-48a4-b64d-5ac71ae3b845 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:31.392510 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188f67a-f1e8-48a4-b64d-5ac71ae3b845 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:31.393263 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3188f67a-f1e8-48a4-b64d-5ac71ae3b845 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:31.396541 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 687/1368] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:59:31 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:31.405354 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9033c-1eb0-41ec-9390-cfe99b378a61 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:31.406400 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9033c-1eb0-41ec-9390-cfe99b378a61 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:31.406898 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9ba9033c-1eb0-41ec-9390-cfe99b378a61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:31.467504 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-492ac805-7dc6-4a87-9acc-2cf0c5c957b7 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:31.514294 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:31.532275 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:31.548742 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-9ba9033c-1eb0-41ec-9390-cfe99b378a61 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:31.551678 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-9ba9033c-1eb0-41ec-9390-cfe99b378a61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:31.684134 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-426b817c-9842-4354-8c6f-a7383a203218 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:31.684939 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b817c-9842-4354-8c6f-a7383a203218 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:31.685346 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b817c-9842-4354-8c6f-a7383a203218 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:31.685689 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-426b817c-9842-4354-8c6f-a7383a203218 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:31.688187 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-426b817c-9842-4354-8c6f-a7383a203218 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:31.733093 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 688/1369] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 321 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:31.873427 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b817c-9842-4354-8c6f-a7383a203218 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:31.876717 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-426b817c-9842-4354-8c6f-a7383a203218 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:31.921586 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 682/1370] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 00:59:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 748 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:59:32.392036 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7138d5-d06e-4e9b-af94-a225a61e3ca0 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:32.392687 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7138d5-d06e-4e9b-af94-a225a61e3ca0 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:32.392975 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e7138d5-d06e-4e9b-af94-a225a61e3ca0 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:32.395663 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 689/1371] 10.222.0.49 () {54 vars in 964 bytes} [Sun Aug 21 00:59:32 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:32.406209 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f131b-fb5e-4de7-972f-40bc1bcbcd44 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:32.407087 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f131b-fb5e-4de7-972f-40bc1bcbcd44 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:32.407087 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10f131b-fb5e-4de7-972f-40bc1bcbcd44 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:32.462181 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:32.536539 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-b10f131b-fb5e-4de7-972f-40bc1bcbcd44 None None] MFA Rules not processed for user `67305d6f08d64f8ba39abe10bd4974c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:32.537846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b10f131b-fb5e-4de7-972f-40bc1bcbcd44 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:32.679195 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 683/1372] 10.222.0.49 () {58 vars in 1061 bytes} [Sun Aug 21 00:59:32 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:32.692094 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7138d5-d06e-4e9b-af94-a225a61e3ca0 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:32.695016 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5e7138d5-d06e-4e9b-af94-a225a61e3ca0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:32.930407 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5e7138d5-d06e-4e9b-af94-a225a61e3ca0 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:32.987271 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:33.085677 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-feb83fb0-0bc1-44be-aec2-a970762a4a32 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67305d6f08d64f8ba39abe10bd4974c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:33.086550 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb83fb0-0bc1-44be-aec2-a970762a4a32 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:33.087268 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb83fb0-0bc1-44be-aec2-a970762a4a32 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:33.087668 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-feb83fb0-0bc1-44be-aec2-a970762a4a32 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:33.092027 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-feb83fb0-0bc1-44be-aec2-a970762a4a32 service cinder] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:33.363476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb83fb0-0bc1-44be-aec2-a970762a4a32 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:33.366693 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-feb83fb0-0bc1-44be-aec2-a970762a4a32 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:33.411431 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 690/1373] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 00:59:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 720 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:59:34.799391 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c741a5-6e3a-4995-b119-f31534a3ba8c None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:34.800239 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c741a5-6e3a-4995-b119-f31534a3ba8c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:34.800239 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41c741a5-6e3a-4995-b119-f31534a3ba8c None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:34.801343 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 684/1374] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:59:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:34.808367 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bba082-92ee-4a8a-882f-c6a37b41e13d None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:34.808977 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bba082-92ee-4a8a-882f-c6a37b41e13d None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:34.809473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-39bba082-92ee-4a8a-882f-c6a37b41e13d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:34.912300 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-39bba082-92ee-4a8a-882f-c6a37b41e13d None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:34.913827 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-39bba082-92ee-4a8a-882f-c6a37b41e13d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:34.923543 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:35.102093 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 691/1375] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 295 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:35.397747 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c741a5-6e3a-4995-b119-f31534a3ba8c None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:35.399295 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-41c741a5-6e3a-4995-b119-f31534a3ba8c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:35.563175 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:35.617006 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41c741a5-6e3a-4995-b119-f31534a3ba8c None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:35.792134 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e328a308-ffed-4531-a153-83af217edaa2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:35.792808 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328a308-ffed-4531-a153-83af217edaa2 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:35.793113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328a308-ffed-4531-a153-83af217edaa2 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:35.793392 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e328a308-ffed-4531-a153-83af217edaa2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:35.795693 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e328a308-ffed-4531-a153-83af217edaa2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:35.907399 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:35.923683 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328a308-ffed-4531-a153-83af217edaa2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:35.925381 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e328a308-ffed-4531-a153-83af217edaa2 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:35.949065 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 685/1376] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 00:59:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 552 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:59:38.440781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5a703-cca8-4c8e-bc02-31032747e57b None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:38.441619 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5a703-cca8-4c8e-bc02-31032747e57b None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:38.441619 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-85c5a703-cca8-4c8e-bc02-31032747e57b None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:38.442808 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 692/1377] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:59:38 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:38.449724 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2268d9-fcd1-4e97-a57f-7e0ed84c4d9e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:38.450563 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2268d9-fcd1-4e97-a57f-7e0ed84c4d9e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:38.450563 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d2268d9-fcd1-4e97-a57f-7e0ed84c4d9e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:38.564139 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-2d2268d9-fcd1-4e97-a57f-7e0ed84c4d9e None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:38.565750 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2d2268d9-fcd1-4e97-a57f-7e0ed84c4d9e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:38.722746 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 686/1378] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 274 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 00:59:39.102323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5a703-cca8-4c8e-bc02-31032747e57b None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:39.105435 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-85c5a703-cca8-4c8e-bc02-31032747e57b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:39.305791 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:39.321174 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-85c5a703-cca8-4c8e-bc02-31032747e57b None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:39.551351 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d82c741b-eac3-4642-a5ab-159b0eff28c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:39.552464 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c741b-eac3-4642-a5ab-159b0eff28c2 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:39.552464 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c741b-eac3-4642-a5ab-159b0eff28c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:39.552769 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d82c741b-eac3-4642-a5ab-159b0eff28c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:39.555649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d82c741b-eac3-4642-a5ab-159b0eff28c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:39.715362 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c741b-eac3-4642-a5ab-159b0eff28c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:39.718198 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d82c741b-eac3-4642-a5ab-159b0eff28c2 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:39.737967 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:39.757438 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 693/1379] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 00:59:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 659 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:59:42.286399 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c4e26-4e41-4c48-9f54-a9b5dbe8b11c None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:42.287005 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c4e26-4e41-4c48-9f54-a9b5dbe8b11c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:42.287355 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f49c4e26-4e41-4c48-9f54-a9b5dbe8b11c None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:42.290147 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 687/1380] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:59:42 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:42.299392 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c411fb-45f2-4fc5-b6ea-44c6b3852ed2 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:42.300141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c411fb-45f2-4fc5-b6ea-44c6b3852ed2 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:42.300334 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-76c411fb-45f2-4fc5-b6ea-44c6b3852ed2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:42.426789 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-76c411fb-45f2-4fc5-b6ea-44c6b3852ed2 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:42.428787 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-76c411fb-45f2-4fc5-b6ea-44c6b3852ed2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:42.658645 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 694/1381] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:42 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:42.967087 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c4e26-4e41-4c48-9f54-a9b5dbe8b11c None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:42.968646 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f49c4e26-4e41-4c48-9f54-a9b5dbe8b11c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:43.049655 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:43.208539 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f49c4e26-4e41-4c48-9f54-a9b5dbe8b11c None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:43.440475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a58ec2d-19b0-4407-829a-f6862483ab99 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:43.441290 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58ec2d-19b0-4407-829a-f6862483ab99 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:43.441441 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58ec2d-19b0-4407-829a-f6862483ab99 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:43.441687 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a58ec2d-19b0-4407-829a-f6862483ab99 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:43.443443 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1a58ec2d-19b0-4407-829a-f6862483ab99 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:43.465175 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:43.594028 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58ec2d-19b0-4407-829a-f6862483ab99 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:43.596987 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a58ec2d-19b0-4407-829a-f6862483ab99 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:43.636953 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 688/1382] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 00:59:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 670 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:59:46.922148 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d4919-0193-44cf-a9d1-d8fadf1457a7 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:46.922811 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d4919-0193-44cf-a9d1-d8fadf1457a7 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:46.922811 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-879d4919-0193-44cf-a9d1-d8fadf1457a7 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:46.924495 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 695/1383] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:59:46 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:46.931785 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d94fe9-fc2c-447b-87d8-cb51ceca3c58 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:46.932419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d94fe9-fc2c-447b-87d8-cb51ceca3c58 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:46.932419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34d94fe9-fc2c-447b-87d8-cb51ceca3c58 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:47.025531 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-34d94fe9-fc2c-447b-87d8-cb51ceca3c58 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:47.026750 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-34d94fe9-fc2c-447b-87d8-cb51ceca3c58 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:47.150062 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:47.158225 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 689/1384] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 228 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:47.462693 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d4919-0193-44cf-a9d1-d8fadf1457a7 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:47.464748 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-879d4919-0193-44cf-a9d1-d8fadf1457a7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:47.555879 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:47.655461 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-879d4919-0193-44cf-a9d1-d8fadf1457a7 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:47.803466 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d9bf21c0-ea4a-48ab-aefb-f26cd96e3faa service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:47.804135 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf21c0-ea4a-48ab-aefb-f26cd96e3faa service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:47.804402 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf21c0-ea4a-48ab-aefb-f26cd96e3faa service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:47.804526 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d9bf21c0-ea4a-48ab-aefb-f26cd96e3faa service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:47.806239 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d9bf21c0-ea4a-48ab-aefb-f26cd96e3faa service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:47.854939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:47.927315 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf21c0-ea4a-48ab-aefb-f26cd96e3faa service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:47.930073 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d9bf21c0-ea4a-48ab-aefb-f26cd96e3faa service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:47.961316 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 696/1385] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 00:59:47 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:59:50.300499 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b4f61-86f8-4448-8053-0302293f7cc2 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:50.301246 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b4f61-86f8-4448-8053-0302293f7cc2 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:50.301491 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb7b4f61-86f8-4448-8053-0302293f7cc2 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:50.303842 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 690/1386] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:59:50 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:59:50.311095 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8b9de-d854-4ca3-8328-c1b84a7f62d6 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:50.311672 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8b9de-d854-4ca3-8328-c1b84a7f62d6 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:50.311771 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2da8b9de-d854-4ca3-8328-c1b84a7f62d6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:50.396909 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-2da8b9de-d854-4ca3-8328-c1b84a7f62d6 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:50.398166 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-2da8b9de-d854-4ca3-8328-c1b84a7f62d6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:50.577508 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 697/1387] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 268 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 00:59:50.876749 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b4f61-86f8-4448-8053-0302293f7cc2 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:50.878619 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-fb7b4f61-86f8-4448-8053-0302293f7cc2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:51.080199 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fb7b4f61-86f8-4448-8053-0302293f7cc2 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:51.173432 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:51.243137 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5c6a7ad3-9ab6-4da2-8e66-cd3eb935e7e7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:51.243137 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a7ad3-9ab6-4da2-8e66-cd3eb935e7e7 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:51.243137 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a7ad3-9ab6-4da2-8e66-cd3eb935e7e7 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:51.243565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5c6a7ad3-9ab6-4da2-8e66-cd3eb935e7e7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:51.245480 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5c6a7ad3-9ab6-4da2-8e66-cd3eb935e7e7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:51.380636 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a7ad3-9ab6-4da2-8e66-cd3eb935e7e7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:51.382774 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5c6a7ad3-9ab6-4da2-8e66-cd3eb935e7e7 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:51.403225 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 691/1388] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 00:59:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 527 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:59:52.272861 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40138e97-9c7e-4023-bffa-7de1554b8be7 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:52.273572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40138e97-9c7e-4023-bffa-7de1554b8be7 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:52.273856 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-40138e97-9c7e-4023-bffa-7de1554b8be7 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:52.276044 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 698/1389] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:59:52 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:52.284151 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767103f-ca6b-47e7-b1bc-ea932e67a321 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:52.284684 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767103f-ca6b-47e7-b1bc-ea932e67a321 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:52.285074 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c767103f-ca6b-47e7-b1bc-ea932e67a321 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:52.372803 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-c767103f-ca6b-47e7-b1bc-ea932e67a321 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:52.374550 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c767103f-ca6b-47e7-b1bc-ea932e67a321 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:52.415602 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:52.488193 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 692/1390] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 205 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:52.884668 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ef7ec-9cbc-4b3f-b919-a0f9a88d61fb None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:52.884991 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ef7ec-9cbc-4b3f-b919-a0f9a88d61fb None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:52.885396 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be1ef7ec-9cbc-4b3f-b919-a0f9a88d61fb None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:52.887311 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 699/1391] 10.222.0.49 () {54 vars in 967 bytes} [Sun Aug 21 00:59:52 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:52.895219 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f4ff1-7218-4597-85ae-fb6267a15f6b None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:52.895583 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f4ff1-7218-4597-85ae-fb6267a15f6b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:52.896020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-228f4ff1-7218-4597-85ae-fb6267a15f6b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:53.014236 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-228f4ff1-7218-4597-85ae-fb6267a15f6b None None] MFA Rules not processed for user `77362a2134af4ede855882c58f40c472`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:53.015570 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-228f4ff1-7218-4597-85ae-fb6267a15f6b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:53.112944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 693/1392] 10.222.0.49 () {58 vars in 1064 bytes} [Sun Aug 21 00:59:52 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 219 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:53.126110 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ef7ec-9cbc-4b3f-b919-a0f9a88d61fb None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:53.127877 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-be1ef7ec-9cbc-4b3f-b919-a0f9a88d61fb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:53.144374 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:53.296318 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be1ef7ec-9cbc-4b3f-b919-a0f9a88d61fb None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:53.419368 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a563770d-5b78-4720-9b82-6045c293e27a service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77362a2134af4ede855882c58f40c472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:53.420275 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563770d-5b78-4720-9b82-6045c293e27a service glance] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:53.420747 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563770d-5b78-4720-9b82-6045c293e27a service glance] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:53.421257 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a563770d-5b78-4720-9b82-6045c293e27a service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:53.424397 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a563770d-5b78-4720-9b82-6045c293e27a service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:53.540991 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:53.590167 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563770d-5b78-4720-9b82-6045c293e27a service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:53.592338 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a563770d-5b78-4720-9b82-6045c293e27a service glance] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:53.621929 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 700/1393] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 00:59:53 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 497 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 00:59:53.819943 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a9d31-0e49-4d0d-b161-0414aafd878b None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:53.820524 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a9d31-0e49-4d0d-b161-0414aafd878b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:53.820636 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-689a9d31-0e49-4d0d-b161-0414aafd878b None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:53.822341 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 694/1394] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:59:53 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:59:53.829248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adfa6c-3e1b-4917-98a9-414487a3dcb2 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:53.829586 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adfa6c-3e1b-4917-98a9-414487a3dcb2 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:53.829922 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f4adfa6c-3e1b-4917-98a9-414487a3dcb2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:53.926689 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-f4adfa6c-3e1b-4917-98a9-414487a3dcb2 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:53.927968 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-f4adfa6c-3e1b-4917-98a9-414487a3dcb2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:54.056567 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 701/1395] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 229 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 00:59:54.375124 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a9d31-0e49-4d0d-b161-0414aafd878b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:54.377076 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-689a9d31-0e49-4d0d-b161-0414aafd878b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:54.419055 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:54.470260 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a20b3e-301f-48e8-9606-4042fe70f626 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:54.471031 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a20b3e-301f-48e8-9606-4042fe70f626 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:54.471031 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56a20b3e-301f-48e8-9606-4042fe70f626 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:54.502504 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:54.562613 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-56a20b3e-301f-48e8-9606-4042fe70f626 None None] MFA Rules not processed for user `a06f043017114f9090264293f5ede6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:54.563875 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-56a20b3e-301f-48e8-9606-4042fe70f626 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:54.597200 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-689a9d31-0e49-4d0d-b161-0414aafd878b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:54.686017 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 702/1396] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 21 00:59:54 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 00:59:54.732658 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee25ccc-dfdb-4b86-b9b2-a8aecfe629f4 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:54.732942 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee25ccc-dfdb-4b86-b9b2-a8aecfe629f4 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:54.733254 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aee25ccc-dfdb-4b86-b9b2-a8aecfe629f4 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:54.734627 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 703/1397] 10.222.0.49 () {54 vars in 943 bytes} [Sun Aug 21 00:59:54 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 00:59:54.741588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2ae47-da63-49d0-b291-783637f66469 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:54.741876 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2ae47-da63-49d0-b291-783637f66469 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:54.742142 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4df2ae47-da63-49d0-b291-783637f66469 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:54.749808 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:54.763777 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d510fcd-e154-4626-84bc-16b2372ea63b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:54.764458 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d510fcd-e154-4626-84bc-16b2372ea63b service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:54.764780 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d510fcd-e154-4626-84bc-16b2372ea63b service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:54.765101 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d510fcd-e154-4626-84bc-16b2372ea63b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:54.766756 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2d510fcd-e154-4626-84bc-16b2372ea63b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:54.840098 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-4df2ae47-da63-49d0-b291-783637f66469 None None] MFA Rules not processed for user `f66a877fdca340f48f54b48e5367a194`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:54.841513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4df2ae47-da63-49d0-b291-783637f66469 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:54.889354 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d510fcd-e154-4626-84bc-16b2372ea63b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:54.890991 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2d510fcd-e154-4626-84bc-16b2372ea63b service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:54.908170 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:54.912341 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 695/1398] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 00:59:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 537 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 00:59:54.996479 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 704/1399] 10.222.0.49 () {58 vars in 1040 bytes} [Sun Aug 21 00:59:54 2022] POST /identity/v3/auth/tokens => generated 3304 bytes in 256 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 00:59:55.006751 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d510fcd-e154-4626-84bc-16b2372ea63b service nova] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:55.008106 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2d510fcd-e154-4626-84bc-16b2372ea63b service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:55.152534 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2d510fcd-e154-4626-84bc-16b2372ea63b service nova] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:55.204807 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:55.332305 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a0547470-9be5-4ff7-ac62-c5e9554f5579 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66a877fdca340f48f54b48e5367a194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:55.332958 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0547470-9be5-4ff7-ac62-c5e9554f5579 service swift] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:55.333387 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0547470-9be5-4ff7-ac62-c5e9554f5579 service swift] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:55.333763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a0547470-9be5-4ff7-ac62-c5e9554f5579 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:55.335722 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a0547470-9be5-4ff7-ac62-c5e9554f5579 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:55.455801 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0547470-9be5-4ff7-ac62-c5e9554f5579 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:55.458707 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a0547470-9be5-4ff7-ac62-c5e9554f5579 service swift] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:55.471730 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 696/1400] 10.222.0.49 () {60 vars in 1384 bytes} [Sun Aug 21 00:59:55 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 465 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 00:59:57.138562 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8c576-a5ed-44db-b453-5f6b9a2c3465 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:57.139577 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8c576-a5ed-44db-b453-5f6b9a2c3465 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:57.139577 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ced8c576-a5ed-44db-b453-5f6b9a2c3465 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:57.141356 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 705/1401] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 00:59:57 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 00:59:57.149521 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a463c7-cdf2-4041-ad60-86a646a3d180 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:57.150403 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a463c7-cdf2-4041-ad60-86a646a3d180 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:57.150403 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-47a463c7-cdf2-4041-ad60-86a646a3d180 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:57.282927 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-47a463c7-cdf2-4041-ad60-86a646a3d180 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 00:59:57.285852 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-47a463c7-cdf2-4041-ad60-86a646a3d180 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:57.300284 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:57.473132 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 697/1402] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 00:59:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 325 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 00:59:57.963178 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8c576-a5ed-44db-b453-5f6b9a2c3465 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 00:59:57.964944 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-ced8c576-a5ed-44db-b453-5f6b9a2c3465 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:58.230198 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ced8c576-a5ed-44db-b453-5f6b9a2c3465 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 00:59:58.277496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 00:59:58.442761 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd37164f-6075-4e51-866f-499948509c2c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 00:59:58.443783 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37164f-6075-4e51-866f-499948509c2c service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 00:59:58.444258 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37164f-6075-4e51-866f-499948509c2c service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 00:59:58.444743 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd37164f-6075-4e51-866f-499948509c2c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 00:59:58.448048 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-fd37164f-6075-4e51-866f-499948509c2c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 00:59:58.620212 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37164f-6075-4e51-866f-499948509c2c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 00:59:58.621895 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd37164f-6075-4e51-866f-499948509c2c service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 00:59:58.649899 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 706/1403] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 00:59:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 687 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:00:01.194747 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52003e0-807e-4b7e-938e-3c86b5345b55 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:01.195669 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52003e0-807e-4b7e-938e-3c86b5345b55 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:01.195669 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d52003e0-807e-4b7e-938e-3c86b5345b55 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:01.197089 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 698/1404] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 01:00:01 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 01:00:01.203353 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dbb2f-62d2-4d25-abfc-c47a4530af63 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:01.203951 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dbb2f-62d2-4d25-abfc-c47a4530af63 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:01.203951 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f01dbb2f-62d2-4d25-abfc-c47a4530af63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:01.274484 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:01.314725 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-f01dbb2f-62d2-4d25-abfc-c47a4530af63 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:00:01.317210 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-f01dbb2f-62d2-4d25-abfc-c47a4530af63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:01.483144 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 707/1405] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 01:00:01 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 281 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:00:01.941763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52003e0-807e-4b7e-938e-3c86b5345b55 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:00:01.944804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d52003e0-807e-4b7e-938e-3c86b5345b55 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:02.322869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:02.337183 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d52003e0-807e-4b7e-938e-3c86b5345b55 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:00:02.576829 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-17a01901-659f-42d6-80ff-0fc262cad633 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:00:02.577787 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a01901-659f-42d6-80ff-0fc262cad633 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:02.578463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a01901-659f-42d6-80ff-0fc262cad633 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:02.578818 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17a01901-659f-42d6-80ff-0fc262cad633 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:02.580722 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-17a01901-659f-42d6-80ff-0fc262cad633 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:02.790278 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a01901-659f-42d6-80ff-0fc262cad633 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:00:02.792210 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-17a01901-659f-42d6-80ff-0fc262cad633 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:00:02.816067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:02.821834 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 699/1406] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:00:01 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 881 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:00:05.603746 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9dcf3-f1ff-42df-ba40-74b31efe1b60 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:05.604885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9dcf3-f1ff-42df-ba40-74b31efe1b60 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:05.605458 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2ac9dcf3-f1ff-42df-ba40-74b31efe1b60 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:05.607476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 708/1407] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 01:00:05 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:00:05.619435 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9ffd5-6fe1-48a0-8f74-22e4d716eee8 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:05.620545 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9ffd5-6fe1-48a0-8f74-22e4d716eee8 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:05.620753 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8fc9ffd5-6fe1-48a0-8f74-22e4d716eee8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:05.732398 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-8fc9ffd5-6fe1-48a0-8f74-22e4d716eee8 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:00:05.734179 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8fc9ffd5-6fe1-48a0-8f74-22e4d716eee8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:05.919299 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 700/1408] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 01:00:05 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 303 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:00:06.333924 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9dcf3-f1ff-42df-ba40-74b31efe1b60 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:00:06.336611 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-2ac9dcf3-f1ff-42df-ba40-74b31efe1b60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:06.596078 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:06.693195 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2ac9dcf3-f1ff-42df-ba40-74b31efe1b60 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:00:06.889277 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-07644713-ac93-4f5f-a10b-f15af9a870c7 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:00:06.890172 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07644713-ac93-4f5f-a10b-f15af9a870c7 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:06.890665 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07644713-ac93-4f5f-a10b-f15af9a870c7 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:06.891148 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-07644713-ac93-4f5f-a10b-f15af9a870c7 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:06.894966 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-07644713-ac93-4f5f-a10b-f15af9a870c7 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:07.073922 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:07.120576 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07644713-ac93-4f5f-a10b-f15af9a870c7 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:00:07.120576 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-07644713-ac93-4f5f-a10b-f15af9a870c7 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:00:07.148230 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 709/1409] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:00:06 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 815 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:00:15.917141 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=65 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:17.144042 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=13 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:22.278039 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60692ed1-a9b0-4f01-9ecd-fabaab18b036 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:22.278617 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60692ed1-a9b0-4f01-9ecd-fabaab18b036 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:22.278617 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60692ed1-a9b0-4f01-9ecd-fabaab18b036 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:22.279949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 701/1410] 10.222.0.49 () {54 vars in 918 bytes} [Sun Aug 21 01:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:00:22.285814 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53821ad2-08d2-41b6-b7c3-0a661e422b63 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:22.286352 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53821ad2-08d2-41b6-b7c3-0a661e422b63 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:22.286462 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53821ad2-08d2-41b6-b7c3-0a661e422b63 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:22.373537 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-53821ad2-08d2-41b6-b7c3-0a661e422b63 None None] MFA Rules not processed for user `3a225f81f16e4cf2a1e62bbb3ec8eee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:00:22.374779 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-53821ad2-08d2-41b6-b7c3-0a661e422b63 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:22.496323 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 710/1411] 10.222.0.49 () {58 vars in 1015 bytes} [Sun Aug 21 01:00:22 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 211 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:00:22.513615 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437351e-898e-4c92-9330-f1e417525a2d None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:22.513888 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437351e-898e-4c92-9330-f1e417525a2d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:22.514150 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b437351e-898e-4c92-9330-f1e417525a2d None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:22.515625 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 702/1412] 10.222.0.49 () {54 vars in 918 bytes} [Sun Aug 21 01:00:22 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:00:22.528455 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e0460-ca97-464f-b0ed-5896e708fe7a None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:22.528756 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e0460-ca97-464f-b0ed-5896e708fe7a None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:22.528936 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d22e0460-ca97-464f-b0ed-5896e708fe7a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:22.630118 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:22.633987 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-d22e0460-ca97-464f-b0ed-5896e708fe7a None None] MFA Rules not processed for user `6b003ae4a082485ab608bf84c1657159`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:00:22.635573 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d22e0460-ca97-464f-b0ed-5896e708fe7a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:22.766603 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 711/1413] 10.222.0.49 () {58 vars in 1015 bytes} [Sun Aug 21 01:00:22 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 240 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:00:25.221369 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af5538-abf4-4ffa-b797-0595ac98a812 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:25.221914 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af5538-abf4-4ffa-b797-0595ac98a812 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:25.222045 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78af5538-abf4-4ffa-b797-0595ac98a812 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:25.223648 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 703/1414] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:00:25 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:00:25.230975 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7852f-89fd-4946-ab16-ec3e7f3a20bf None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:25.231535 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7852f-89fd-4946-ab16-ec3e7f3a20bf None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:25.231865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c4f7852f-89fd-4946-ab16-ec3e7f3a20bf None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:25.321543 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-c4f7852f-89fd-4946-ab16-ec3e7f3a20bf None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:00:25.322775 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c4f7852f-89fd-4946-ab16-ec3e7f3a20bf None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:25.395041 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:25.446404 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 712/1415] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:00:25 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 217 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:00:25.733455 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af5538-abf4-4ffa-b797-0595ac98a812 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:00:25.735118 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-78af5538-abf4-4ffa-b797-0595ac98a812 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:25.917418 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78af5538-abf4-4ffa-b797-0595ac98a812 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:00:26.012949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:26.061596 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf68dc6-1711-478a-a335-8e80ca0a8652 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:00:26.062209 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf68dc6-1711-478a-a335-8e80ca0a8652 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:26.062482 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf68dc6-1711-478a-a335-8e80ca0a8652 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:26.062769 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf68dc6-1711-478a-a335-8e80ca0a8652 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:26.064401 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-bbf68dc6-1711-478a-a335-8e80ca0a8652 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:26.174036 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf68dc6-1711-478a-a335-8e80ca0a8652 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:00:26.175666 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bbf68dc6-1711-478a-a335-8e80ca0a8652 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:00:26.195529 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 704/1416] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:00:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:00:27.141459 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784041f6-e665-4cd1-b9a5-4ab0fcc182e0 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:27.142029 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784041f6-e665-4cd1-b9a5-4ab0fcc182e0 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:27.142298 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-784041f6-e665-4cd1-b9a5-4ab0fcc182e0 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:27.143945 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 713/1417] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 01:00:27 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:00:27.149905 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0808858-689d-45f4-9657-130e96b18b52 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:27.150478 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0808858-689d-45f4-9657-130e96b18b52 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:27.150478 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f0808858-689d-45f4-9657-130e96b18b52 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:27.252673 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-f0808858-689d-45f4-9657-130e96b18b52 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:00:27.254825 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f0808858-689d-45f4-9657-130e96b18b52 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:27.300906 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:27.383814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 705/1418] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 01:00:27 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 235 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:00:27.535422 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784041f6-e665-4cd1-b9a5-4ab0fcc182e0 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:00:27.537104 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-784041f6-e665-4cd1-b9a5-4ab0fcc182e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:27.716385 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-784041f6-e665-4cd1-b9a5-4ab0fcc182e0 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:00:27.762516 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:27.848528 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ca282c30-6d6a-415a-9e71-373382625a60 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:00:27.849180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca282c30-6d6a-415a-9e71-373382625a60 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:27.849454 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca282c30-6d6a-415a-9e71-373382625a60 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:27.850358 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ca282c30-6d6a-415a-9e71-373382625a60 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:27.851353 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-ca282c30-6d6a-415a-9e71-373382625a60 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:27.958949 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca282c30-6d6a-415a-9e71-373382625a60 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:00:27.960581 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ca282c30-6d6a-415a-9e71-373382625a60 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:00:27.981158 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 714/1419] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:00:27 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 446 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:00:28.891853 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2517192-01e4-4678-95c9-081bcdcf8c6a None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:28.892469 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2517192-01e4-4678-95c9-081bcdcf8c6a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:28.892469 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2517192-01e4-4678-95c9-081bcdcf8c6a None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:28.893960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 706/1420] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 01:00:28 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:00:28.906640 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f8173-1e17-490f-be52-c7aef0836c61 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:28.907298 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f8173-1e17-490f-be52-c7aef0836c61 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:28.907623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-817f8173-1e17-490f-be52-c7aef0836c61 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:28.975373 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:29.005838 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-817f8173-1e17-490f-be52-c7aef0836c61 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:00:29.007073 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-817f8173-1e17-490f-be52-c7aef0836c61 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:29.118476 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 715/1421] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 01:00:28 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:00:29.273997 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2517192-01e4-4678-95c9-081bcdcf8c6a None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:00:29.275695 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b2517192-01e4-4678-95c9-081bcdcf8c6a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:29.449605 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b2517192-01e4-4678-95c9-081bcdcf8c6a None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:00:29.463838 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:29.613628 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-71129721-ca5d-426e-966f-70a9ce047f8c service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:00:29.614533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71129721-ca5d-426e-966f-70a9ce047f8c service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:29.614786 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71129721-ca5d-426e-966f-70a9ce047f8c service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:29.615098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71129721-ca5d-426e-966f-70a9ce047f8c service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:29.616733 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-71129721-ca5d-426e-966f-70a9ce047f8c service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:29.743307 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71129721-ca5d-426e-966f-70a9ce047f8c service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:00:29.745605 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-71129721-ca5d-426e-966f-70a9ce047f8c service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:00:29.772672 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 707/1422] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:00:29 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 499 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:00:30.659069 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22786aed-0910-4558-ae84-2593ca1ef0ec None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:30.659666 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22786aed-0910-4558-ae84-2593ca1ef0ec None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:30.659666 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-22786aed-0910-4558-ae84-2593ca1ef0ec None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:30.660961 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 716/1423] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 01:00:30 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:00:30.666920 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59084b9f-2b82-462e-b796-417a26453b9c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:30.667510 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59084b9f-2b82-462e-b796-417a26453b9c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:30.667510 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59084b9f-2b82-462e-b796-417a26453b9c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:30.689296 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:30.764856 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-59084b9f-2b82-462e-b796-417a26453b9c None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:00:30.766131 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-59084b9f-2b82-462e-b796-417a26453b9c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:30.877449 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 708/1424] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 01:00:30 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 212 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:00:31.032364 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22786aed-0910-4558-ae84-2593ca1ef0ec None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:00:31.034047 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-22786aed-0910-4558-ae84-2593ca1ef0ec None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:31.165643 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:31.206346 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-22786aed-0910-4558-ae84-2593ca1ef0ec None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:00:31.338351 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fd80f2d-d365-47c6-b916-a9b994d36d61 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:00:31.339106 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd80f2d-d365-47c6-b916-a9b994d36d61 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:31.339490 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd80f2d-d365-47c6-b916-a9b994d36d61 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:31.339946 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fd80f2d-d365-47c6-b916-a9b994d36d61 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:31.342116 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5fd80f2d-d365-47c6-b916-a9b994d36d61 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:31.443845 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:31.461375 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd80f2d-d365-47c6-b916-a9b994d36d61 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:00:31.463122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5fd80f2d-d365-47c6-b916-a9b994d36d61 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:00:31.487585 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 717/1425] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:00:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 456 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:00:32.375033 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44de7fd-9e93-4409-91f1-29255ac4e21d None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:32.375646 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44de7fd-9e93-4409-91f1-29255ac4e21d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:32.375646 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e44de7fd-9e93-4409-91f1-29255ac4e21d None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:32.377304 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 709/1426] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 01:00:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:00:32.383142 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b2342-b217-468c-aa09-e4f776ca053e None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:32.383682 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b2342-b217-468c-aa09-e4f776ca053e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:32.383682 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-858b2342-b217-468c-aa09-e4f776ca053e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:32.476480 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-858b2342-b217-468c-aa09-e4f776ca053e None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:00:32.477665 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-858b2342-b217-468c-aa09-e4f776ca053e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:32.595026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 718/1427] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 01:00:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 213 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:00:32.746123 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44de7fd-9e93-4409-91f1-29255ac4e21d None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:00:32.747579 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e44de7fd-9e93-4409-91f1-29255ac4e21d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:32.842797 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:32.918916 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e44de7fd-9e93-4409-91f1-29255ac4e21d None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:00:33.052057 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f1dd484a-2378-4cdc-a0d4-08b6d7c667e5 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:00:33.052588 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd484a-2378-4cdc-a0d4-08b6d7c667e5 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:33.052869 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd484a-2378-4cdc-a0d4-08b6d7c667e5 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:33.053207 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1dd484a-2378-4cdc-a0d4-08b6d7c667e5 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:33.055167 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f1dd484a-2378-4cdc-a0d4-08b6d7c667e5 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:33.116315 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:33.164209 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd484a-2378-4cdc-a0d4-08b6d7c667e5 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:00:33.165871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f1dd484a-2378-4cdc-a0d4-08b6d7c667e5 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:00:33.184789 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 710/1428] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:00:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:00:34.010381 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3649066-b8c7-4bda-bcd6-961ef97a52a4 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:34.010963 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3649066-b8c7-4bda-bcd6-961ef97a52a4 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:34.010963 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d3649066-b8c7-4bda-bcd6-961ef97a52a4 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:34.012286 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 719/1429] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 01:00:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 01:00:34.018168 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42fb25-c00c-4e48-8e0d-47d4c791d38e None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:34.018738 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42fb25-c00c-4e48-8e0d-47d4c791d38e None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:34.018738 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42fb25-c00c-4e48-8e0d-47d4c791d38e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:34.109005 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-3e42fb25-c00c-4e48-8e0d-47d4c791d38e None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:00:34.110463 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3e42fb25-c00c-4e48-8e0d-47d4c791d38e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:34.217208 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 711/1430] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 01:00:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 200 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:00:34.367600 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3649066-b8c7-4bda-bcd6-961ef97a52a4 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:00:34.369375 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d3649066-b8c7-4bda-bcd6-961ef97a52a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:34.421037 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:34.557553 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d3649066-b8c7-4bda-bcd6-961ef97a52a4 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:00:34.698041 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-705247cd-be1f-4edf-912a-d105914def7d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:00:34.698660 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705247cd-be1f-4edf-912a-d105914def7d service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:34.699082 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705247cd-be1f-4edf-912a-d105914def7d service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:34.699230 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-705247cd-be1f-4edf-912a-d105914def7d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:34.700811 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-705247cd-be1f-4edf-912a-d105914def7d service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:34.709061 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:34.808381 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705247cd-be1f-4edf-912a-d105914def7d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:00:34.810048 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-705247cd-be1f-4edf-912a-d105914def7d service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:00:34.829701 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 720/1431] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:00:34 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 463 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:00:35.642039 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58be9ec-80c9-41e7-a83b-509957f8607b None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:35.642593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58be9ec-80c9-41e7-a83b-509957f8607b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:35.642593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d58be9ec-80c9-41e7-a83b-509957f8607b None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:35.643868 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 712/1432] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 01:00:35 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:00:35.649750 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210340d-ec82-4d84-a46c-3417660fdf36 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:35.650377 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210340d-ec82-4d84-a46c-3417660fdf36 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:35.650377 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d210340d-ec82-4d84-a46c-3417660fdf36 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:35.737766 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-d210340d-ec82-4d84-a46c-3417660fdf36 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:00:35.739048 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d210340d-ec82-4d84-a46c-3417660fdf36 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:35.810333 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:35.843657 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 721/1433] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 01:00:35 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 195 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:00:35.992293 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58be9ec-80c9-41e7-a83b-509957f8607b None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:00:35.994644 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d58be9ec-80c9-41e7-a83b-509957f8607b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:36.013173 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:36.148544 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d58be9ec-80c9-41e7-a83b-509957f8607b None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:00:36.242575 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:36.270775 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f7a30850-5d93-409f-8867-6ec2e9ac0c06 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:00:36.271395 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a30850-5d93-409f-8867-6ec2e9ac0c06 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:36.271663 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a30850-5d93-409f-8867-6ec2e9ac0c06 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:36.271938 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7a30850-5d93-409f-8867-6ec2e9ac0c06 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:36.273588 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f7a30850-5d93-409f-8867-6ec2e9ac0c06 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:36.375412 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a30850-5d93-409f-8867-6ec2e9ac0c06 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:00:36.377030 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f7a30850-5d93-409f-8867-6ec2e9ac0c06 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:00:36.396772 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 713/1434] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:00:35 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 405 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:00:37.207176 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa730ad-b58c-49eb-8159-acda0bedf9a1 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:37.207772 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa730ad-b58c-49eb-8159-acda0bedf9a1 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:37.207772 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5fa730ad-b58c-49eb-8159-acda0bedf9a1 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:37.209392 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 722/1435] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 01:00:37 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:00:37.215178 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe2e12-57da-4516-9b2f-f532be8c13f3 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:37.216057 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe2e12-57da-4516-9b2f-f532be8c13f3 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:37.216337 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-43fe2e12-57da-4516-9b2f-f532be8c13f3 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:37.300841 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-43fe2e12-57da-4516-9b2f-f532be8c13f3 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:00:37.302127 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-43fe2e12-57da-4516-9b2f-f532be8c13f3 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:37.346766 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:37.405372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 714/1436] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 01:00:37 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:00:37.555273 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa730ad-b58c-49eb-8159-acda0bedf9a1 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:00:37.556854 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5fa730ad-b58c-49eb-8159-acda0bedf9a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:37.716887 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5fa730ad-b58c-49eb-8159-acda0bedf9a1 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:00:37.797630 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:37.864282 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1d92adac-a6cc-4d80-af4d-e6310533a3c2 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:00:37.864907 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92adac-a6cc-4d80-af4d-e6310533a3c2 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:37.865278 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92adac-a6cc-4d80-af4d-e6310533a3c2 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:37.865507 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1d92adac-a6cc-4d80-af4d-e6310533a3c2 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:37.867223 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-1d92adac-a6cc-4d80-af4d-e6310533a3c2 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:37.974120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92adac-a6cc-4d80-af4d-e6310533a3c2 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:00:37.975682 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1d92adac-a6cc-4d80-af4d-e6310533a3c2 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:00:37.995122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 723/1437] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:00:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:00:38.836876 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f1028-7a8c-4da2-aba4-684ae53d6f8d None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:38.837522 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f1028-7a8c-4da2-aba4-684ae53d6f8d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:38.837645 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-624f1028-7a8c-4da2-aba4-684ae53d6f8d None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:38.839119 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 715/1438] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 01:00:38 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:00:38.845438 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e10a73-9bbd-4075-9a06-c0d3b0b6878a None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:38.845954 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e10a73-9bbd-4075-9a06-c0d3b0b6878a None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:38.846049 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-17e10a73-9bbd-4075-9a06-c0d3b0b6878a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:38.931852 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-17e10a73-9bbd-4075-9a06-c0d3b0b6878a None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:00:38.933186 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-17e10a73-9bbd-4075-9a06-c0d3b0b6878a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:38.935399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:39.037803 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 724/1439] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 01:00:38 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:00:39.189960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f1028-7a8c-4da2-aba4-684ae53d6f8d None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:00:39.191521 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-624f1028-7a8c-4da2-aba4-684ae53d6f8d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:39.364768 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-624f1028-7a8c-4da2-aba4-684ae53d6f8d None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:00:39.395040 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:39.497151 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1e15d462-f341-4668-a6e7-174278707411 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:00:39.497812 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15d462-f341-4668-a6e7-174278707411 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:39.498089 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15d462-f341-4668-a6e7-174278707411 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:39.498357 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e15d462-f341-4668-a6e7-174278707411 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:39.500055 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1e15d462-f341-4668-a6e7-174278707411 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:39.615789 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15d462-f341-4668-a6e7-174278707411 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:00:39.618700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1e15d462-f341-4668-a6e7-174278707411 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:00:39.653756 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 716/1440] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:00:39 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 464 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:00:41.530145 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac44090-0309-4f78-9970-fc968b26d4a1 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:41.530691 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac44090-0309-4f78-9970-fc968b26d4a1 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:41.530691 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7ac44090-0309-4f78-9970-fc968b26d4a1 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:41.532054 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 725/1441] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:00:41 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:00:41.538448 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d62adb-fe58-4efe-b7d1-1df31d48940a None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:41.538974 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d62adb-fe58-4efe-b7d1-1df31d48940a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:41.538974 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-54d62adb-fe58-4efe-b7d1-1df31d48940a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:41.584232 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:41.614617 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-54d62adb-fe58-4efe-b7d1-1df31d48940a None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:00:41.615863 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-54d62adb-fe58-4efe-b7d1-1df31d48940a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:41.739795 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 717/1442] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:00:41 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:00:42.034951 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac44090-0309-4f78-9970-fc968b26d4a1 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:00:42.036851 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7ac44090-0309-4f78-9970-fc968b26d4a1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:42.166132 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7ac44090-0309-4f78-9970-fc968b26d4a1 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:00:42.200585 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:42.250514 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f681c2ad-2062-4afc-b6e1-98a2585ae8b9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:00:42.251326 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681c2ad-2062-4afc-b6e1-98a2585ae8b9 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:42.251683 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681c2ad-2062-4afc-b6e1-98a2585ae8b9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:42.252031 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f681c2ad-2062-4afc-b6e1-98a2585ae8b9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:42.254373 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-f681c2ad-2062-4afc-b6e1-98a2585ae8b9 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:42.381233 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681c2ad-2062-4afc-b6e1-98a2585ae8b9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:00:42.382630 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f681c2ad-2062-4afc-b6e1-98a2585ae8b9 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:00:42.402459 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 726/1443] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:00:42 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:00:44.563520 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b41e18-ea2f-42b3-907c-d2d365306e09 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:44.564089 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b41e18-ea2f-42b3-907c-d2d365306e09 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:44.564089 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-56b41e18-ea2f-42b3-907c-d2d365306e09 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:44.565567 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 718/1444] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:00:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:00:44.571707 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33363f-5b49-4e9b-b0a9-fe18d375414b None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:44.572224 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33363f-5b49-4e9b-b0a9-fe18d375414b None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:44.572344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3b33363f-5b49-4e9b-b0a9-fe18d375414b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:44.647010 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-3b33363f-5b49-4e9b-b0a9-fe18d375414b None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:00:44.648236 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-3b33363f-5b49-4e9b-b0a9-fe18d375414b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:44.663508 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:44.758057 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 727/1445] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:00:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 187 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:00:45.047127 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b41e18-ea2f-42b3-907c-d2d365306e09 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:00:45.048704 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-56b41e18-ea2f-42b3-907c-d2d365306e09 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:45.180044 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-56b41e18-ea2f-42b3-907c-d2d365306e09 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:00:45.193881 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:45.263217 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ccc10d18-e474-4704-bd46-2d83dd5b0301 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:00:45.263861 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc10d18-e474-4704-bd46-2d83dd5b0301 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:45.264138 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc10d18-e474-4704-bd46-2d83dd5b0301 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:45.264410 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ccc10d18-e474-4704-bd46-2d83dd5b0301 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:45.266067 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ccc10d18-e474-4704-bd46-2d83dd5b0301 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:45.393432 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc10d18-e474-4704-bd46-2d83dd5b0301 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:00:45.394924 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ccc10d18-e474-4704-bd46-2d83dd5b0301 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:00:45.414940 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 719/1446] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:00:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 368 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:00:47.755220 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd971d2f-abc2-40c3-a720-edd4e257b3da None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:47.755844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd971d2f-abc2-40c3-a720-edd4e257b3da None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:47.755844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd971d2f-abc2-40c3-a720-edd4e257b3da None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:47.757167 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 728/1447] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:00:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:00:47.762999 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbe5b1-c446-495b-9671-2b23ba3d5689 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:47.763494 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbe5b1-c446-495b-9671-2b23ba3d5689 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:47.763494 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-98cbe5b1-c446-495b-9671-2b23ba3d5689 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:47.814161 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:47.832429 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-98cbe5b1-c446-495b-9671-2b23ba3d5689 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:00:47.833685 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-98cbe5b1-c446-495b-9671-2b23ba3d5689 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:47.934494 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 720/1448] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:00:47 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:00:48.215441 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd971d2f-abc2-40c3-a720-edd4e257b3da None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:00:48.217318 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-fd971d2f-abc2-40c3-a720-edd4e257b3da None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:48.343893 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd971d2f-abc2-40c3-a720-edd4e257b3da None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:00:48.388576 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:48.431737 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cb3f27d3-f114-4064-8e9b-26b7ef4f4e13 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:00:48.432353 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f27d3-f114-4064-8e9b-26b7ef4f4e13 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:48.432626 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f27d3-f114-4064-8e9b-26b7ef4f4e13 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:48.432877 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cb3f27d3-f114-4064-8e9b-26b7ef4f4e13 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:48.434567 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-cb3f27d3-f114-4064-8e9b-26b7ef4f4e13 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:48.554599 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f27d3-f114-4064-8e9b-26b7ef4f4e13 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:00:48.555987 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cb3f27d3-f114-4064-8e9b-26b7ef4f4e13 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:00:48.575265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 729/1449] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:00:48 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:00:50.688833 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2763dae-33aa-417c-b712-38700b7b55f1 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:50.689515 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2763dae-33aa-417c-b712-38700b7b55f1 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:50.689515 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f2763dae-33aa-417c-b712-38700b7b55f1 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:50.690646 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 721/1450] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:00:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:00:50.696882 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216e90e-0b4c-4782-b9d9-f3897f3394ad None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:50.697513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216e90e-0b4c-4782-b9d9-f3897f3394ad None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:50.697513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6216e90e-0b4c-4782-b9d9-f3897f3394ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:50.773076 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-6216e90e-0b4c-4782-b9d9-f3897f3394ad None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:00:50.774426 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-6216e90e-0b4c-4782-b9d9-f3897f3394ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:50.805556 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:50.910059 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 730/1451] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:00:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 214 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:00:51.188112 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2763dae-33aa-417c-b712-38700b7b55f1 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:00:51.189861 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f2763dae-33aa-417c-b712-38700b7b55f1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:51.337260 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f2763dae-33aa-417c-b712-38700b7b55f1 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:00:51.362133 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:51.419546 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9980fcc-a1b8-46f0-8dea-4e8ef930befc service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:00:51.420142 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9980fcc-a1b8-46f0-8dea-4e8ef930befc service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:51.420411 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9980fcc-a1b8-46f0-8dea-4e8ef930befc service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:51.420668 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9980fcc-a1b8-46f0-8dea-4e8ef930befc service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:51.422315 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-c9980fcc-a1b8-46f0-8dea-4e8ef930befc service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:51.537467 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9980fcc-a1b8-46f0-8dea-4e8ef930befc service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:00:51.538905 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9980fcc-a1b8-46f0-8dea-4e8ef930befc service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:00:51.558985 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 722/1452] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:00:51 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 371 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:00:53.565405 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651ee17-a43d-42ee-ab54-a832b58a9474 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:53.566332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651ee17-a43d-42ee-ab54-a832b58a9474 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:53.566332 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b651ee17-a43d-42ee-ab54-a832b58a9474 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:53.568847 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 731/1453] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:00:53 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:00:53.577930 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e690031-8375-433d-84ab-bac3e91ed047 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:53.578752 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e690031-8375-433d-84ab-bac3e91ed047 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:53.578752 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0e690031-8375-433d-84ab-bac3e91ed047 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:53.658791 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:53.663020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-0e690031-8375-433d-84ab-bac3e91ed047 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:00:53.664949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0e690031-8375-433d-84ab-bac3e91ed047 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:53.796472 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 723/1454] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:00:53 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 220 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:00:54.094585 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651ee17-a43d-42ee-ab54-a832b58a9474 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:00:54.096123 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b651ee17-a43d-42ee-ab54-a832b58a9474 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:54.217023 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b651ee17-a43d-42ee-ab54-a832b58a9474 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:00:54.272424 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:54.300651 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9524941-be81-45ad-a324-ab6b403845dd service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:00:54.301299 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9524941-be81-45ad-a324-ab6b403845dd service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:54.301736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9524941-be81-45ad-a324-ab6b403845dd service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:54.301866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9524941-be81-45ad-a324-ab6b403845dd service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:54.303511 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c9524941-be81-45ad-a324-ab6b403845dd service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:54.438888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9524941-be81-45ad-a324-ab6b403845dd service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:00:54.440265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9524941-be81-45ad-a324-ab6b403845dd service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:00:54.463453 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 732/1455] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:00:54 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 369 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:00:57.080577 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908d9de-3511-4d2d-a99a-2531eef09632 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:57.081244 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908d9de-3511-4d2d-a99a-2531eef09632 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:57.081244 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2908d9de-3511-4d2d-a99a-2531eef09632 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:57.082766 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 724/1456] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:00:57 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:00:57.088901 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9a256-9461-4232-a58d-51bd28ab70b1 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:57.089573 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9a256-9461-4232-a58d-51bd28ab70b1 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:57.089573 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06f9a256-9461-4232-a58d-51bd28ab70b1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:57.158911 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-06f9a256-9461-4232-a58d-51bd28ab70b1 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:00:57.160183 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-06f9a256-9461-4232-a58d-51bd28ab70b1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:57.191184 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:57.266350 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 733/1457] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:00:57 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:00:57.548399 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908d9de-3511-4d2d-a99a-2531eef09632 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:00:57.550111 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-2908d9de-3511-4d2d-a99a-2531eef09632 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:57.670864 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2908d9de-3511-4d2d-a99a-2531eef09632 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:00:57.701277 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:00:57.751131 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3d7526da-c649-4906-9488-720be23a36e3 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:00:57.751650 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7526da-c649-4906-9488-720be23a36e3 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:00:57.751929 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7526da-c649-4906-9488-720be23a36e3 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:00:57.752194 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3d7526da-c649-4906-9488-720be23a36e3 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:00:57.753849 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3d7526da-c649-4906-9488-720be23a36e3 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:00:57.879292 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7526da-c649-4906-9488-720be23a36e3 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:00:57.880854 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3d7526da-c649-4906-9488-720be23a36e3 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:00:57.909081 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 725/1458] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:00:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 361 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:01:00.017971 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae83652-04bd-4c73-8255-515f6187e0fd None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:00.018693 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae83652-04bd-4c73-8255-515f6187e0fd None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:00.018693 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aae83652-04bd-4c73-8255-515f6187e0fd None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:00.019942 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 734/1459] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:01:00 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:00.027945 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c111f-cf4d-4ab1-b924-3a11ddc02dae None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:00.028568 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c111f-cf4d-4ab1-b924-3a11ddc02dae None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:00.028568 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-047c111f-cf4d-4ab1-b924-3a11ddc02dae None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:00.115335 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-047c111f-cf4d-4ab1-b924-3a11ddc02dae None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:00.116475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-047c111f-cf4d-4ab1-b924-3a11ddc02dae None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:00.126648 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:00.272626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 726/1460] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:01:00 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 246 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:00.567637 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae83652-04bd-4c73-8255-515f6187e0fd None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:00.569378 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-aae83652-04bd-4c73-8255-515f6187e0fd None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:00.710899 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aae83652-04bd-4c73-8255-515f6187e0fd None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:00.777580 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:00.797953 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7023a647-023a-401f-9658-1134cdce96ea service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:00.798879 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023a647-023a-401f-9658-1134cdce96ea service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:00.799112 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023a647-023a-401f-9658-1134cdce96ea service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:00.799377 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7023a647-023a-401f-9658-1134cdce96ea service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:00.801216 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7023a647-023a-401f-9658-1134cdce96ea service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:00.923735 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023a647-023a-401f-9658-1134cdce96ea service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:00.925294 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7023a647-023a-401f-9658-1134cdce96ea service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:00.945757 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 735/1461] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:01:00 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 379 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:01:03.048477 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dfca2-e781-48d2-aa28-60b5c38f07c2 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:03.049213 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dfca2-e781-48d2-aa28-60b5c38f07c2 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:03.049213 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a91dfca2-e781-48d2-aa28-60b5c38f07c2 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:03.050675 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 727/1462] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:01:03 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:03.057353 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640342a-ea41-4329-8d96-e0b82f7854a4 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:03.058085 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640342a-ea41-4329-8d96-e0b82f7854a4 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:03.058085 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1640342a-ea41-4329-8d96-e0b82f7854a4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:03.149442 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-1640342a-ea41-4329-8d96-e0b82f7854a4 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:03.150744 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-1640342a-ea41-4329-8d96-e0b82f7854a4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:03.204064 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:03.305810 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 736/1463] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:01:03 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 250 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:03.835909 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dfca2-e781-48d2-aa28-60b5c38f07c2 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:03.838984 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a91dfca2-e781-48d2-aa28-60b5c38f07c2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:04.047467 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a91dfca2-e781-48d2-aa28-60b5c38f07c2 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:04.116278 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:04.163680 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-369989a3-123d-448b-8d33-e2797183858d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:04.164684 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369989a3-123d-448b-8d33-e2797183858d service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:04.165192 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369989a3-123d-448b-8d33-e2797183858d service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:04.165657 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-369989a3-123d-448b-8d33-e2797183858d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:04.168706 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-369989a3-123d-448b-8d33-e2797183858d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:04.321377 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369989a3-123d-448b-8d33-e2797183858d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:04.323007 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-369989a3-123d-448b-8d33-e2797183858d service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:04.346480 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 728/1464] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:01:03 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 512 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:01:06.456011 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbeb8b3-36cd-41ec-9de4-1faf3c5b7ae6 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:06.456919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbeb8b3-36cd-41ec-9de4-1faf3c5b7ae6 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:06.456919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9fbeb8b3-36cd-41ec-9de4-1faf3c5b7ae6 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:06.458518 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 737/1465] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:01:06 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 01:01:06.465073 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ced3a1-f2e3-4e23-ab86-92c9b9d46b5d None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:06.465612 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ced3a1-f2e3-4e23-ab86-92c9b9d46b5d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:06.465951 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d4ced3a1-f2e3-4e23-ab86-92c9b9d46b5d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:06.558093 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-d4ced3a1-f2e3-4e23-ab86-92c9b9d46b5d None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:06.559943 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d4ced3a1-f2e3-4e23-ab86-92c9b9d46b5d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:06.593699 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:06.756102 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 729/1466] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:01:06 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 292 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:01:07.041652 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbeb8b3-36cd-41ec-9de4-1faf3c5b7ae6 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:07.043586 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-9fbeb8b3-36cd-41ec-9de4-1faf3c5b7ae6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:07.202153 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9fbeb8b3-36cd-41ec-9de4-1faf3c5b7ae6 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:07.313202 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:07.322880 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08a5dc92-4898-42a4-8ca7-c0e7f0b198e5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:07.323900 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5dc92-4898-42a4-8ca7-c0e7f0b198e5 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:07.324312 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5dc92-4898-42a4-8ca7-c0e7f0b198e5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:07.324588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08a5dc92-4898-42a4-8ca7-c0e7f0b198e5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:07.326409 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-08a5dc92-4898-42a4-8ca7-c0e7f0b198e5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:07.526105 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5dc92-4898-42a4-8ca7-c0e7f0b198e5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:07.529526 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08a5dc92-4898-42a4-8ca7-c0e7f0b198e5 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:07.561654 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 738/1467] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:01:07 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 521 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:01:09.737592 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ca952-42ba-49fa-bef1-38b1d00fa81f None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:09.738147 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ca952-42ba-49fa-bef1-38b1d00fa81f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:09.738147 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-322ca952-42ba-49fa-bef1-38b1d00fa81f None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:09.739445 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 730/1468] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:01:09 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:09.745895 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f413083-07d2-4f34-816a-732adad53a99 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:09.746467 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f413083-07d2-4f34-816a-732adad53a99 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:09.746467 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2f413083-07d2-4f34-816a-732adad53a99 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:09.842078 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-2f413083-07d2-4f34-816a-732adad53a99 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:09.843608 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-2f413083-07d2-4f34-816a-732adad53a99 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:09.904550 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:09.988914 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 739/1469] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:01:09 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 244 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:10.279721 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ca952-42ba-49fa-bef1-38b1d00fa81f None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:10.281499 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-322ca952-42ba-49fa-bef1-38b1d00fa81f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:10.422144 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-322ca952-42ba-49fa-bef1-38b1d00fa81f None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:10.495210 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:10.530260 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02d3cf42-cfd3-4d8a-a8d0-1dc070e64682 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:10.530919 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3cf42-cfd3-4d8a-a8d0-1dc070e64682 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:10.531247 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3cf42-cfd3-4d8a-a8d0-1dc070e64682 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:10.531561 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02d3cf42-cfd3-4d8a-a8d0-1dc070e64682 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:10.533586 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-02d3cf42-cfd3-4d8a-a8d0-1dc070e64682 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:10.708552 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3cf42-cfd3-4d8a-a8d0-1dc070e64682 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:10.711263 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-02d3cf42-cfd3-4d8a-a8d0-1dc070e64682 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:10.746688 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 731/1470] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:01:10 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 467 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:01:19.986462 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=22 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:20.741720 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=66 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:31.080571 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b07e86-b943-4132-98ed-3769016da8df None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:31.081560 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b07e86-b943-4132-98ed-3769016da8df None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:31.081560 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-81b07e86-b943-4132-98ed-3769016da8df None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:31.083704 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 740/1471] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 01:01:31 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:31.092616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2925126-fef2-482a-9eb1-bf967cb8a54b None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:31.093289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2925126-fef2-482a-9eb1-bf967cb8a54b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:31.093289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2925126-fef2-482a-9eb1-bf967cb8a54b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:31.177641 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-d2925126-fef2-482a-9eb1-bf967cb8a54b None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:31.178904 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-d2925126-fef2-482a-9eb1-bf967cb8a54b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:31.287363 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 732/1472] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 01:01:31 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 196 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:31.582437 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e47b4-f9b9-4832-b44e-ea88865caee5 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:31.582694 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e47b4-f9b9-4832-b44e-ea88865caee5 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:31.582968 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff3e47b4-f9b9-4832-b44e-ea88865caee5 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:31.584330 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 741/1473] 10.222.0.49 () {54 vars in 967 bytes} [Sun Aug 21 01:01:31 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 01:01:31.590023 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf59a9-5e79-4c30-951b-53fcd571648f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:31.590430 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf59a9-5e79-4c30-951b-53fcd571648f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:31.590798 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9caf59a9-5e79-4c30-951b-53fcd571648f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:31.677797 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-9caf59a9-5e79-4c30-951b-53fcd571648f None None] MFA Rules not processed for user `77362a2134af4ede855882c58f40c472`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:31.679249 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9caf59a9-5e79-4c30-951b-53fcd571648f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:31.703128 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:31.781179 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 733/1474] 10.222.0.49 () {58 vars in 1064 bytes} [Sun Aug 21 01:01:31 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 192 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:31.797132 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e47b4-f9b9-4832-b44e-ea88865caee5 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:31.799927 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-ff3e47b4-f9b9-4832-b44e-ea88865caee5 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:31.949526 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff3e47b4-f9b9-4832-b44e-ea88865caee5 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:32.042286 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b5c7735f-2ca5-4602-a6fc-10192a5c185c service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77362a2134af4ede855882c58f40c472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:32.042816 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7735f-2ca5-4602-a6fc-10192a5c185c service glance] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:32.043089 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7735f-2ca5-4602-a6fc-10192a5c185c service glance] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:32.043350 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b5c7735f-2ca5-4602-a6fc-10192a5c185c service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:32.044989 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b5c7735f-2ca5-4602-a6fc-10192a5c185c service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:32.107195 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:32.189550 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7735f-2ca5-4602-a6fc-10192a5c185c service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:32.191118 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b5c7735f-2ca5-4602-a6fc-10192a5c185c service glance] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:32.211540 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 742/1475] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:01:31 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 416 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:01:34.258055 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907d037-272c-4797-b22b-ea31c1818ac8 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:34.258692 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907d037-272c-4797-b22b-ea31c1818ac8 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:34.258692 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5907d037-272c-4797-b22b-ea31c1818ac8 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:34.260109 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 734/1476] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 01:01:34 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:34.265887 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06177c-6689-4235-b859-7e97b7b6cbe6 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:34.266440 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06177c-6689-4235-b859-7e97b7b6cbe6 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:34.266440 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4e06177c-6689-4235-b859-7e97b7b6cbe6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:34.334858 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-4e06177c-6689-4235-b859-7e97b7b6cbe6 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:34.336119 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-4e06177c-6689-4235-b859-7e97b7b6cbe6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:34.438394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 743/1477] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 01:01:34 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 174 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:34.708751 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907d037-272c-4797-b22b-ea31c1818ac8 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:34.710398 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5907d037-272c-4797-b22b-ea31c1818ac8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:34.852397 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5907d037-272c-4797-b22b-ea31c1818ac8 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:34.906324 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:34.954049 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eadd88fa-2a03-43b4-bf9e-6209e044d534 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:34.954694 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd88fa-2a03-43b4-bf9e-6209e044d534 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:34.954969 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd88fa-2a03-43b4-bf9e-6209e044d534 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:34.955209 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eadd88fa-2a03-43b4-bf9e-6209e044d534 admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:34.955984 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd88fa-2a03-43b4-bf9e-6209e044d534 admin admin] RBAC: Authorizing `identity:list_projects()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:34.957947 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: WARNING py.warnings [None req-eadd88fa-2a03-43b4-bf9e-6209e044d534 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_projects": "(role:reader and system_scope:all) or (role:reader and domain_id:%(target.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:01:34.957947 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: warnings.warn(msg) Aug 21 01:01:34.957947 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: Aug 21 01:01:34.959179 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-eadd88fa-2a03-43b4-bf9e-6209e044d534 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:34.978948 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 735/1478] 10.222.0.49 () {56 vars in 1108 bytes} [Sun Aug 21 01:01:34 2022] GET /identity/v3/projects => generated 2553 bytes in 271 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:01:36.943855 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9bfa2-f3fb-4ea0-994d-2b5cf9175efe None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:36.944503 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9bfa2-f3fb-4ea0-994d-2b5cf9175efe None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:36.944727 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67f9bfa2-f3fb-4ea0-994d-2b5cf9175efe None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:36.947226 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 744/1479] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 01:01:36 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:36.953754 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92e462-0f9e-4f5b-ab9f-2108e15eea54 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:36.954612 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92e462-0f9e-4f5b-ab9f-2108e15eea54 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:36.954612 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb92e462-0f9e-4f5b-ab9f-2108e15eea54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:37.043711 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-fb92e462-0f9e-4f5b-ab9f-2108e15eea54 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:37.044971 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-fb92e462-0f9e-4f5b-ab9f-2108e15eea54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:37.154957 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 736/1480] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 01:01:36 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:37.448930 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9bfa2-f3fb-4ea0-994d-2b5cf9175efe None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:37.450532 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-67f9bfa2-f3fb-4ea0-994d-2b5cf9175efe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:37.460830 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:37.616140 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67f9bfa2-f3fb-4ea0-994d-2b5cf9175efe None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:37.705904 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:37.742408 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-713566c2-998c-4926-b057-e9aec94c2b96 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:37.742937 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713566c2-998c-4926-b057-e9aec94c2b96 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:37.743572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713566c2-998c-4926-b057-e9aec94c2b96 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:37.743841 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-713566c2-998c-4926-b057-e9aec94c2b96 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:37.745585 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-713566c2-998c-4926-b057-e9aec94c2b96 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:37.847938 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713566c2-998c-4926-b057-e9aec94c2b96 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:37.849651 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-713566c2-998c-4926-b057-e9aec94c2b96 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:37.872773 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 745/1481] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:01:37 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 424 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:01:40.056717 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02270871-9239-4565-91ff-2f205386a5ce None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:40.057409 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02270871-9239-4565-91ff-2f205386a5ce None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:40.057409 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-02270871-9239-4565-91ff-2f205386a5ce None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:40.058770 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 737/1482] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 01:01:40 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:40.065363 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62a322-4ae8-44c5-8e4a-9157e8579cc9 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:40.066005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62a322-4ae8-44c5-8e4a-9157e8579cc9 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:40.066005 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9e62a322-4ae8-44c5-8e4a-9157e8579cc9 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:40.267535 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-9e62a322-4ae8-44c5-8e4a-9157e8579cc9 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:40.268947 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-9e62a322-4ae8-44c5-8e4a-9157e8579cc9 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:40.319623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:40.379114 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 746/1483] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 01:01:40 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 315 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:40.665690 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02270871-9239-4565-91ff-2f205386a5ce None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:40.667380 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-02270871-9239-4565-91ff-2f205386a5ce None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:40.697682 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:40.789005 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-02270871-9239-4565-91ff-2f205386a5ce None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:40.870861 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b78cbf97-d454-4839-ba57-99bf743ba3a6 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:40.871486 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cbf97-d454-4839-ba57-99bf743ba3a6 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:40.871777 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cbf97-d454-4839-ba57-99bf743ba3a6 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:40.872040 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b78cbf97-d454-4839-ba57-99bf743ba3a6 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:40.873731 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b78cbf97-d454-4839-ba57-99bf743ba3a6 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:41.083300 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:41.126807 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78cbf97-d454-4839-ba57-99bf743ba3a6 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:41.128329 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b78cbf97-d454-4839-ba57-99bf743ba3a6 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:41.152286 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 738/1484] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:01:40 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 487 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:01:43.245218 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87827d2-a6de-476c-92b0-ec15d8ec2ab8 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:43.245848 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87827d2-a6de-476c-92b0-ec15d8ec2ab8 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:43.245848 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d87827d2-a6de-476c-92b0-ec15d8ec2ab8 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:43.247198 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 747/1485] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 01:01:43 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:43.253350 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2947c57-bce4-482e-9b79-59c712005b1b None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:43.253921 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2947c57-bce4-482e-9b79-59c712005b1b None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:43.253921 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b2947c57-bce4-482e-9b79-59c712005b1b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:43.338365 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-b2947c57-bce4-482e-9b79-59c712005b1b None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:43.340063 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b2947c57-bce4-482e-9b79-59c712005b1b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:43.454801 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 739/1486] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 01:01:43 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:43.748134 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87827d2-a6de-476c-92b0-ec15d8ec2ab8 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:43.750597 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d87827d2-a6de-476c-92b0-ec15d8ec2ab8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:43.908598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d87827d2-a6de-476c-92b0-ec15d8ec2ab8 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:44.000064 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:44.002456 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0de83294-ede9-49e4-978a-cc8a4c74689d service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:44.003221 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de83294-ede9-49e4-978a-cc8a4c74689d service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:44.003779 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de83294-ede9-49e4-978a-cc8a4c74689d service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:44.004100 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0de83294-ede9-49e4-978a-cc8a4c74689d service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:44.006425 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-0de83294-ede9-49e4-978a-cc8a4c74689d service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:44.160657 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de83294-ede9-49e4-978a-cc8a4c74689d service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:44.162245 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0de83294-ede9-49e4-978a-cc8a4c74689d service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:44.185430 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 748/1487] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:01:43 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 438 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:01:46.297154 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3880cf4-3494-4cd3-b149-59fb8d4e9594 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:46.297858 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3880cf4-3494-4cd3-b149-59fb8d4e9594 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:46.298011 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b3880cf4-3494-4cd3-b149-59fb8d4e9594 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:46.300107 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 740/1488] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 01:01:46 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:46.307405 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b9ba8-a3bd-4d5b-982f-92c4e76ef8ed None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:46.307960 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b9ba8-a3bd-4d5b-982f-92c4e76ef8ed None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:46.307960 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b10b9ba8-a3bd-4d5b-982f-92c4e76ef8ed None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:46.386190 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-b10b9ba8-a3bd-4d5b-982f-92c4e76ef8ed None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:46.387444 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b10b9ba8-a3bd-4d5b-982f-92c4e76ef8ed None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:46.448948 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:46.499130 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 749/1489] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 01:01:46 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 193 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:46.792900 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3880cf4-3494-4cd3-b149-59fb8d4e9594 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:46.794864 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b3880cf4-3494-4cd3-b149-59fb8d4e9594 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:46.835145 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:46.917292 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b3880cf4-3494-4cd3-b149-59fb8d4e9594 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:46.997524 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-41db7688-ab74-4c37-a736-4b069616ed9c service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:46.998166 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db7688-ab74-4c37-a736-4b069616ed9c service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:46.998419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db7688-ab74-4c37-a736-4b069616ed9c service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:46.998700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-41db7688-ab74-4c37-a736-4b069616ed9c service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:47.000343 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-41db7688-ab74-4c37-a736-4b069616ed9c service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:47.103179 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:47.138343 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db7688-ab74-4c37-a736-4b069616ed9c service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:47.139789 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-41db7688-ab74-4c37-a736-4b069616ed9c service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:47.162159 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 741/1490] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:01:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 370 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:01:49.421190 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3da696-0aa1-4b01-9b70-89d430d3709f None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:49.421764 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3da696-0aa1-4b01-9b70-89d430d3709f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:49.421764 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5b3da696-0aa1-4b01-9b70-89d430d3709f None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:49.423088 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 750/1491] 10.222.0.49 () {54 vars in 927 bytes} [Sun Aug 21 01:01:49 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:01:49.430576 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e332500-41b7-46ff-aea3-5f73150a2134 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:49.431165 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e332500-41b7-46ff-aea3-5f73150a2134 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:49.431553 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6e332500-41b7-46ff-aea3-5f73150a2134 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:49.526506 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-6e332500-41b7-46ff-aea3-5f73150a2134 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:01:49.528197 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6e332500-41b7-46ff-aea3-5f73150a2134 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:49.654866 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 742/1492] 10.222.0.49 () {58 vars in 1024 bytes} [Sun Aug 21 01:01:49 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 226 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:01:49.983150 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3da696-0aa1-4b01-9b70-89d430d3709f None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:01:49.984735 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5b3da696-0aa1-4b01-9b70-89d430d3709f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:50.106360 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5b3da696-0aa1-4b01-9b70-89d430d3709f None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:01:50.194353 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b290c1f8-125f-4b33-916e-dbe4e7ca5c83 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:01:50.195320 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290c1f8-125f-4b33-916e-dbe4e7ca5c83 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:01:50.195602 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290c1f8-125f-4b33-916e-dbe4e7ca5c83 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:01:50.195879 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b290c1f8-125f-4b33-916e-dbe4e7ca5c83 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:01:50.197699 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b290c1f8-125f-4b33-916e-dbe4e7ca5c83 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:01:50.208646 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:01:50.362053 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290c1f8-125f-4b33-916e-dbe4e7ca5c83 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:01:50.364741 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b290c1f8-125f-4b33-916e-dbe4e7ca5c83 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:01:50.401184 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 751/1493] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:01:49 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 419 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:01:59.655338 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=82 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:02:00.396602 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=50 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:10.651356 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e9582-3410-41e8-b4df-0827a3bf4e6d None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:10.652087 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e9582-3410-41e8-b4df-0827a3bf4e6d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:10.652087 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb7e9582-3410-41e8-b4df-0827a3bf4e6d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:10.736343 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-bb7e9582-3410-41e8-b4df-0827a3bf4e6d None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:03:10.737612 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-bb7e9582-3410-41e8-b4df-0827a3bf4e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:10.841001 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 743/1494] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 21 01:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 191 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:03:10.849965 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffc090-66d4-4573-b2e7-ea74ccfda172 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:10.850689 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffc090-66d4-4573-b2e7-ea74ccfda172 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:10.850689 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b9ffc090-66d4-4573-b2e7-ea74ccfda172 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:10.938095 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-b9ffc090-66d4-4573-b2e7-ea74ccfda172 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:03:10.939360 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-b9ffc090-66d4-4573-b2e7-ea74ccfda172 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:11.051047 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 752/1495] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 21 01:03:10 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 202 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:03:11.056205 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e9582-3410-41e8-b4df-0827a3bf4e6d None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:03:11.057469 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-bb7e9582-3410-41e8-b4df-0827a3bf4e6d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:11.069506 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bb7e9582-3410-41e8-b4df-0827a3bf4e6d None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:03:11.137365 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:11.175767 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353009b1-fe9f-40d1-a887-a79808b27217 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:03:11.176396 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353009b1-fe9f-40d1-a887-a79808b27217 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:11.176674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353009b1-fe9f-40d1-a887-a79808b27217 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:11.176935 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-353009b1-fe9f-40d1-a887-a79808b27217 admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:11.177642 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353009b1-fe9f-40d1-a887-a79808b27217 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:03:11.178009 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353009b1-fe9f-40d1-a887-a79808b27217 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:03:11.179080 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: WARNING py.warnings [None req-353009b1-fe9f-40d1-a887-a79808b27217 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:03:11.179080 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: warnings.warn(msg) Aug 21 01:03:11.179080 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: Aug 21 01:03:11.180010 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-353009b1-fe9f-40d1-a887-a79808b27217 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:03:11.193572 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 744/1496] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 21 01:03:11 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 138 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:03:11.202706 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffc090-66d4-4573-b2e7-ea74ccfda172 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:03:11.212871 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b9ffc090-66d4-4573-b2e7-ea74ccfda172 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:03:11.283442 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:11.326577 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee84d0-3f38-488d-952d-5fbd60b36360 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:03:11.327213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee84d0-3f38-488d-952d-5fbd60b36360 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:11.327485 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee84d0-3f38-488d-952d-5fbd60b36360 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:11.327746 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a8ee84d0-3f38-488d-952d-5fbd60b36360 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:11.328381 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee84d0-3f38-488d-952d-5fbd60b36360 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:03:11.330345 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: WARNING py.warnings [None req-a8ee84d0-3f38-488d-952d-5fbd60b36360 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:03:11.330345 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: warnings.warn(msg) Aug 21 01:03:11.330345 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: Aug 21 01:03:11.331560 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a8ee84d0-3f38-488d-952d-5fbd60b36360 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:03:11.408402 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 753/1497] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 21 01:03:11 2022] POST /identity/v3/projects => generated 375 bytes in 206 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:03:11.414391 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353009b1-fe9f-40d1-a887-a79808b27217 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:03:11.418091 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-353009b1-fe9f-40d1-a887-a79808b27217 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:11.459157 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-353009b1-fe9f-40d1-a887-a79808b27217 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:03:11.571992 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c538d50-5edb-47fe-be1d-6c7fff9a465d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:03:11.572624 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c538d50-5edb-47fe-be1d-6c7fff9a465d admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:11.572900 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c538d50-5edb-47fe-be1d-6c7fff9a465d admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:11.573332 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8c538d50-5edb-47fe-be1d-6c7fff9a465d admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:11.573852 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c538d50-5edb-47fe-be1d-6c7fff9a465d admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:03:11.574887 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: WARNING py.warnings [None req-8c538d50-5edb-47fe-be1d-6c7fff9a465d admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:03:11.574887 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: warnings.warn(msg) Aug 21 01:03:11.574887 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: Aug 21 01:03:11.576805 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8c538d50-5edb-47fe-be1d-6c7fff9a465d admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:03:11.624795 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 745/1498] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 21 01:03:11 2022] POST /identity/v3/users => generated 288 bytes in 211 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:03:11.629163 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee84d0-3f38-488d-952d-5fbd60b36360 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:03:11.630710 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a8ee84d0-3f38-488d-952d-5fbd60b36360 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:11.699025 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a8ee84d0-3f38-488d-952d-5fbd60b36360 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:03:11.808370 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:11.823305 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da28f7-da7c-4d27-8ad8-98490352d99c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:03:11.823952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da28f7-da7c-4d27-8ad8-98490352d99c admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:11.824215 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da28f7-da7c-4d27-8ad8-98490352d99c admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:11.824489 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a6da28f7-da7c-4d27-8ad8-98490352d99c admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:11.825224 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da28f7-da7c-4d27-8ad8-98490352d99c admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:03:11.826263 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: WARNING py.warnings [None req-a6da28f7-da7c-4d27-8ad8-98490352d99c admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:03:11.826263 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: warnings.warn(msg) Aug 21 01:03:11.826263 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: Aug 21 01:03:11.827175 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a6da28f7-da7c-4d27-8ad8-98490352d99c admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:03:11.841883 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 754/1499] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 21 01:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 213 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:03:11.846540 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c538d50-5edb-47fe-be1d-6c7fff9a465d admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:03:11.849639 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8c538d50-5edb-47fe-be1d-6c7fff9a465d admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:11.864365 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8c538d50-5edb-47fe-be1d-6c7fff9a465d admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:03:11.882893 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8ffd7bef-f20d-4d44-bf04-51c03806b3ff admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:03:11.883690 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd7bef-f20d-4d44-bf04-51c03806b3ff admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:11.884105 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd7bef-f20d-4d44-bf04-51c03806b3ff admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:11.884451 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8ffd7bef-f20d-4d44-bf04-51c03806b3ff admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:11.885573 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd7bef-f20d-4d44-bf04-51c03806b3ff admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:03:11.886760 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: WARNING py.warnings [None req-8ffd7bef-f20d-4d44-bf04-51c03806b3ff admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_roles": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:03:11.886760 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: warnings.warn(msg) Aug 21 01:03:11.886760 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: Aug 21 01:03:11.887814 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8ffd7bef-f20d-4d44-bf04-51c03806b3ff admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:03:11.903922 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 746/1500] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 21 01:03:11 2022] GET /identity/v3/roles => generated 1420 bytes in 58 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:03:11.908772 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da28f7-da7c-4d27-8ad8-98490352d99c admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:03:11.910538 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a6da28f7-da7c-4d27-8ad8-98490352d99c admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:11.960163 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a6da28f7-da7c-4d27-8ad8-98490352d99c admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:03:12.076014 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c7b04d63-de0e-405c-a6e4-39ae6cac9634 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:03:12.076591 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b04d63-de0e-405c-a6e4-39ae6cac9634 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:12.076896 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b04d63-de0e-405c-a6e4-39ae6cac9634 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:12.077169 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c7b04d63-de0e-405c-a6e4-39ae6cac9634 admin admin] PATH_INFO: `/v3/projects/2fc96d0b8ff24d2b8631e24ec4ade927/users/abc71168f42643258cf216d16774600e/roles/54545d831b9e469dad64f2d28c12e462` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:12.105680 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b04d63-de0e-405c-a6e4-39ae6cac9634 admin admin] RBAC: Authorizing `identity:create_grant(project_id=2fc96d0b8ff24d2b8631e24ec4ade927, user_id=abc71168f42643258cf216d16774600e, role_id=54545d831b9e469dad64f2d28c12e462)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:03:12.106775 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: WARNING py.warnings [None req-c7b04d63-de0e-405c-a6e4-39ae6cac9634 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:03:12.106775 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: warnings.warn(msg) Aug 21 01:03:12.106775 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: Aug 21 01:03:12.108875 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c7b04d63-de0e-405c-a6e4-39ae6cac9634 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:03:12.147496 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 755/1501] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 21 01:03:11 2022] PUT /identity/v3/projects/2fc96d0b8ff24d2b8631e24ec4ade927/users/abc71168f42643258cf216d16774600e/roles/54545d831b9e469dad64f2d28c12e462 => generated 0 bytes in 239 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:03:12.162819 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850d7b3-1574-4d98-8ce8-29d40129dd2d None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:12.162819 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850d7b3-1574-4d98-8ce8-29d40129dd2d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:12.162819 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f850d7b3-1574-4d98-8ce8-29d40129dd2d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:12.177813 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:12.237427 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-f850d7b3-1574-4d98-8ce8-29d40129dd2d None None] MFA Rules not processed for user `abc71168f42643258cf216d16774600e`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:03:12.238686 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-f850d7b3-1574-4d98-8ce8-29d40129dd2d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:12.320657 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 747/1502] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 21 01:03:12 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 161 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:03:12.335105 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e36ca0-c0cd-48e4-8f26-bb174edbf4ac None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:12.335374 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e36ca0-c0cd-48e4-8f26-bb174edbf4ac None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:12.335697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-06e36ca0-c0cd-48e4-8f26-bb174edbf4ac None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:12.337351 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 756/1503] 10.222.0.49 () {54 vars in 964 bytes} [Sun Aug 21 01:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:03:12.343252 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e2202-f39b-43e3-84ee-f20c6161f9e2 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:12.343582 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e2202-f39b-43e3-84ee-f20c6161f9e2 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:12.343788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-878e2202-f39b-43e3-84ee-f20c6161f9e2 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:12.428126 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-878e2202-f39b-43e3-84ee-f20c6161f9e2 None None] MFA Rules not processed for user `67305d6f08d64f8ba39abe10bd4974c9`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:03:12.429413 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-878e2202-f39b-43e3-84ee-f20c6161f9e2 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:12.508959 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 748/1504] 10.222.0.49 () {58 vars in 1061 bytes} [Sun Aug 21 01:03:12 2022] POST /identity/v3/auth/tokens => generated 3120 bytes in 167 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:03:12.517732 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e36ca0-c0cd-48e4-8f26-bb174edbf4ac None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:03:12.530995 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-06e36ca0-c0cd-48e4-8f26-bb174edbf4ac None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:03:12.534959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44bdf4-5a62-482d-884a-73b80fadd243 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67305d6f08d64f8ba39abe10bd4974c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:03:12.535572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44bdf4-5a62-482d-884a-73b80fadd243 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:12.535965 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44bdf4-5a62-482d-884a-73b80fadd243 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:12.536232 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e44bdf4-5a62-482d-884a-73b80fadd243 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:12.545983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44bdf4-5a62-482d-884a-73b80fadd243 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:03:12.547458 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e44bdf4-5a62-482d-884a-73b80fadd243 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:03:12.557857 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 757/1505] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:03:12 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:03:12.608407 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c0eae-aec9-40db-bd27-3ecbb959bd03 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:12.608688 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c0eae-aec9-40db-bd27-3ecbb959bd03 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:12.608978 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2d3c0eae-aec9-40db-bd27-3ecbb959bd03 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:12.610402 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 749/1506] 10.222.0.49 () {52 vars in 830 bytes} [Sun Aug 21 01:03:12 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:03:12.615896 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44bdf4-5a62-482d-884a-73b80fadd243 service cinder] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:03:12.628616 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e44bdf4-5a62-482d-884a-73b80fadd243 service cinder] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:03:12.635028 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff45835-80bc-4d33-8b83-6ad69f94eefc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:03:12.635681 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff45835-80bc-4d33-8b83-6ad69f94eefc admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:12.635963 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff45835-80bc-4d33-8b83-6ad69f94eefc admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:12.636240 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-cff45835-80bc-4d33-8b83-6ad69f94eefc admin admin] PATH_INFO: `/v3/users/abc71168f42643258cf216d16774600e` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:12.637688 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff45835-80bc-4d33-8b83-6ad69f94eefc admin admin] RBAC: Authorizing `identity:delete_user(user_id=abc71168f42643258cf216d16774600e)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:03:12.638644 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: WARNING py.warnings [None req-cff45835-80bc-4d33-8b83-6ad69f94eefc admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:03:12.638644 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: warnings.warn(msg) Aug 21 01:03:12.638644 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: Aug 21 01:03:12.639881 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-cff45835-80bc-4d33-8b83-6ad69f94eefc admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:03:12.695053 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=94,keystone:INSERT=1,keystone:DELETE=5 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:12.721959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-cff45835-80bc-4d33-8b83-6ad69f94eefc admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'abc71168f42643258cf216d16774600e'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:03:12.737333 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-cff45835-80bc-4d33-8b83-6ad69f94eefc admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'abc71168f42643258cf216d16774600e'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:03:12.738203 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-cff45835-80bc-4d33-8b83-6ad69f94eefc admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'abc71168f42643258cf216d16774600e'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:03:12.750298 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-cff45835-80bc-4d33-8b83-6ad69f94eefc admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'abc71168f42643258cf216d16774600e'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:03:12.775663 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-cff45835-80bc-4d33-8b83-6ad69f94eefc admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'abc71168f42643258cf216d16774600e'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:03:12.782101 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 758/1507] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 21 01:03:12 2022] DELETE /identity/v3/users/abc71168f42643258cf216d16774600e => generated 0 bytes in 167 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:03:12.786871 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6df14-cedd-42d8-a6c6-06c1d4aabb1c None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:12.787263 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6df14-cedd-42d8-a6c6-06c1d4aabb1c None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:12.787731 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ac6df14-cedd-42d8-a6c6-06c1d4aabb1c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:12.819273 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-5ac6df14-cedd-42d8-a6c6-06c1d4aabb1c None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:03:12.820574 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5ac6df14-cedd-42d8-a6c6-06c1d4aabb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:12.832820 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:12.889004 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 750/1508] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 21 01:03:12 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 103 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:03:12.899100 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff45835-80bc-4d33-8b83-6ad69f94eefc admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:03:12.900732 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-cff45835-80bc-4d33-8b83-6ad69f94eefc admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:12.985697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-cff45835-80bc-4d33-8b83-6ad69f94eefc admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:03:12.989981 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-55993241-c9d6-46db-9813-722ec91a2fc8 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:03:12.990861 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55993241-c9d6-46db-9813-722ec91a2fc8 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:12.991157 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55993241-c9d6-46db-9813-722ec91a2fc8 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:12.991516 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-55993241-c9d6-46db-9813-722ec91a2fc8 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:13.002689 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55993241-c9d6-46db-9813-722ec91a2fc8 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:03:13.004203 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-55993241-c9d6-46db-9813-722ec91a2fc8 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:03:13.015175 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 759/1509] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:03:12 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:03:13.377173 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6df14-cedd-42d8-a6c6-06c1d4aabb1c None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:03:13.379142 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-5ac6df14-cedd-42d8-a6c6-06c1d4aabb1c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:03:13.394924 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ac6df14-cedd-42d8-a6c6-06c1d4aabb1c None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:03:13.401567 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7133bcd9-6442-4349-8f5f-e4fc18bfd208 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:03:13.402614 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133bcd9-6442-4349-8f5f-e4fc18bfd208 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:03:13.403084 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133bcd9-6442-4349-8f5f-e4fc18bfd208 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:03:13.403558 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7133bcd9-6442-4349-8f5f-e4fc18bfd208 admin admin] PATH_INFO: `/v3/projects/2fc96d0b8ff24d2b8631e24ec4ade927` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:03:13.405695 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133bcd9-6442-4349-8f5f-e4fc18bfd208 admin admin] RBAC: Authorizing `identity:delete_project(project_id=2fc96d0b8ff24d2b8631e24ec4ade927)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:03:13.407549 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: WARNING py.warnings [None req-7133bcd9-6442-4349-8f5f-e4fc18bfd208 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:03:13.407549 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: warnings.warn(msg) Aug 21 01:03:13.407549 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: Aug 21 01:03:13.409889 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7133bcd9-6442-4349-8f5f-e4fc18bfd208 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:03:13.493063 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-7133bcd9-6442-4349-8f5f-e4fc18bfd208 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '2fc96d0b8ff24d2b8631e24ec4ade927', 'request_id': 'req-7133bcd9-6442-4349-8f5f-e4fc18bfd208'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:03:13.499784 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-7133bcd9-6442-4349-8f5f-e4fc18bfd208 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '2fc96d0b8ff24d2b8631e24ec4ade927', 'request_id': 'req-7133bcd9-6442-4349-8f5f-e4fc18bfd208'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:03:13.516166 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-7133bcd9-6442-4349-8f5f-e4fc18bfd208 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '2fc96d0b8ff24d2b8631e24ec4ade927', 'request_id': 'req-7133bcd9-6442-4349-8f5f-e4fc18bfd208'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:03:13.542329 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-7133bcd9-6442-4349-8f5f-e4fc18bfd208 admin admin] The token cache is being invalidate because project 2fc96d0b8ff24d2b8631e24ec4ade927 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:03:13.542636 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-7133bcd9-6442-4349-8f5f-e4fc18bfd208 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:03:13.543372 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-7133bcd9-6442-4349-8f5f-e4fc18bfd208 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:03:13.545186 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 751/1510] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 21 01:03:13 2022] DELETE /identity/v3/projects/2fc96d0b8ff24d2b8631e24ec4ade927 => generated 0 bytes in 170 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:03:23.009972 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=54,keystone:DELETE=5,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:03:23.536837 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=47,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:04:32.084757 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40ad27-3e57-4fb1-969a-6ef5350fd7d7 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:32.085432 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40ad27-3e57-4fb1-969a-6ef5350fd7d7 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:32.085432 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1b40ad27-3e57-4fb1-969a-6ef5350fd7d7 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:32.086730 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 760/1511] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 01:04:32 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:04:32.092090 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437d78f-c252-4941-b3e5-3143b1d2747f None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:32.092579 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437d78f-c252-4941-b3e5-3143b1d2747f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:32.092681 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7437d78f-c252-4941-b3e5-3143b1d2747f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:32.136342 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-7437d78f-c252-4941-b3e5-3143b1d2747f None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:04:32.137642 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7437d78f-c252-4941-b3e5-3143b1d2747f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:32.208967 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 752/1512] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 01:04:32 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 118 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:04:32.362346 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40ad27-3e57-4fb1-969a-6ef5350fd7d7 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:04:32.364410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-1b40ad27-3e57-4fb1-969a-6ef5350fd7d7 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:32.472386 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1b40ad27-3e57-4fb1-969a-6ef5350fd7d7 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:04:32.478270 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e3caf447-aed5-4898-ad73-609d69376e35 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:04:32.478889 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caf447-aed5-4898-ad73-609d69376e35 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:32.479142 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caf447-aed5-4898-ad73-609d69376e35 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:32.479427 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e3caf447-aed5-4898-ad73-609d69376e35 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:32.498754 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3caf447-aed5-4898-ad73-609d69376e35 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:04:32.500409 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e3caf447-aed5-4898-ad73-609d69376e35 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:04:32.511176 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 761/1513] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:04:32 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 149 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:04:33.341444 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879e9b6-ae9d-4cbb-a046-273e38c7daf4 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:33.342049 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879e9b6-ae9d-4cbb-a046-273e38c7daf4 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:33.342049 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6879e9b6-ae9d-4cbb-a046-273e38c7daf4 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:33.343359 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 753/1514] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 01:04:33 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:04:33.349468 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6e597-0204-4fb5-925b-f44205e46a2f None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:33.350008 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6e597-0204-4fb5-925b-f44205e46a2f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:33.350008 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-37e6e597-0204-4fb5-925b-f44205e46a2f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:33.372890 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-37e6e597-0204-4fb5-925b-f44205e46a2f None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:04:33.374133 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-37e6e597-0204-4fb5-925b-f44205e46a2f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:33.383167 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 762/1515] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 01:04:33 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:04:33.536837 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879e9b6-ae9d-4cbb-a046-273e38c7daf4 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:04:33.555963 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6879e9b6-ae9d-4cbb-a046-273e38c7daf4 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:04:33.562500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-418f27d5-5986-4004-a122-dc300f9fcbef service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:04:33.563156 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f27d5-5986-4004-a122-dc300f9fcbef service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:33.563432 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f27d5-5986-4004-a122-dc300f9fcbef service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:33.563703 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-418f27d5-5986-4004-a122-dc300f9fcbef service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:33.573999 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f27d5-5986-4004-a122-dc300f9fcbef service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:04:33.577817 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-418f27d5-5986-4004-a122-dc300f9fcbef service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:04:33.591126 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 754/1516] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:04:33 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:04:36.331144 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92db82-a06e-40fa-a7c0-8ab5913f73c9 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:36.331793 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92db82-a06e-40fa-a7c0-8ab5913f73c9 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:36.331793 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9f92db82-a06e-40fa-a7c0-8ab5913f73c9 None None] PATH_INFO: `/v3` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:36.333033 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 763/1517] 10.222.0.52 () {54 vars in 925 bytes} [Sun Aug 21 01:04:36 2022] GET /identity/v3 => generated 255 bytes in 3 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:04:36.339966 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee309a38-5fa5-47fe-bd0a-521c8694b66a None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:36.340604 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee309a38-5fa5-47fe-bd0a-521c8694b66a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:36.340604 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ee309a38-5fa5-47fe-bd0a-521c8694b66a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:36.399965 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-ee309a38-5fa5-47fe-bd0a-521c8694b66a None None] MFA Rules not processed for user `3a225f81f16e4cf2a1e62bbb3ec8eee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:04:36.401240 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ee309a38-5fa5-47fe-bd0a-521c8694b66a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:36.480866 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 755/1518] 10.222.0.52 () {58 vars in 1015 bytes} [Sun Aug 21 01:04:36 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 142 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:04:43.367604 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=49 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:04:44.860844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c872335-65ca-495e-81d8-1f130298a686 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:44.861569 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c872335-65ca-495e-81d8-1f130298a686 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:44.861569 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2c872335-65ca-495e-81d8-1f130298a686 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:44.862787 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 764/1519] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 01:04:44 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:04:44.868465 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1f9b2-24ed-4e3d-9f12-47d305bc5a1a None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:44.869082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1f9b2-24ed-4e3d-9f12-47d305bc5a1a None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:44.869082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-53a1f9b2-24ed-4e3d-9f12-47d305bc5a1a None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:44.891923 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-53a1f9b2-24ed-4e3d-9f12-47d305bc5a1a None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:04:44.893196 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-53a1f9b2-24ed-4e3d-9f12-47d305bc5a1a None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:44.903437 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 756/1520] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 01:04:44 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:04:45.056963 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c872335-65ca-495e-81d8-1f130298a686 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:04:45.074747 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2c872335-65ca-495e-81d8-1f130298a686 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:04:45.080959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bd39eeee-bc8e-45e1-b3f5-530fd786988f service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:04:45.081662 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39eeee-bc8e-45e1-b3f5-530fd786988f service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:45.081948 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39eeee-bc8e-45e1-b3f5-530fd786988f service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:45.082220 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bd39eeee-bc8e-45e1-b3f5-530fd786988f service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:45.097620 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39eeee-bc8e-45e1-b3f5-530fd786988f service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:04:45.097620 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-bd39eeee-bc8e-45e1-b3f5-530fd786988f service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:04:45.113610 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 765/1521] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:04:45 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:04:45.409485 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521d33b-32cc-4b89-8daa-c11690d6dfec None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:45.409763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521d33b-32cc-4b89-8daa-c11690d6dfec None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:45.409930 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f521d33b-32cc-4b89-8daa-c11690d6dfec None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:45.411470 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 757/1522] 10.222.0.49 () {54 vars in 961 bytes} [Sun Aug 21 01:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:04:45.418108 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05f049-0818-4bb5-a993-e809d38aa93b None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:45.418432 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05f049-0818-4bb5-a993-e809d38aa93b None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:45.418707 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ec05f049-0818-4bb5-a993-e809d38aa93b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:45.441229 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-ec05f049-0818-4bb5-a993-e809d38aa93b None None] MFA Rules not processed for user `3a225f81f16e4cf2a1e62bbb3ec8eee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:04:45.442513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-ec05f049-0818-4bb5-a993-e809d38aa93b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:45.452791 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 766/1523] 10.222.0.49 () {58 vars in 1058 bytes} [Sun Aug 21 01:04:45 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:04:45.461178 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521d33b-32cc-4b89-8daa-c11690d6dfec None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:04:45.475663 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f521d33b-32cc-4b89-8daa-c11690d6dfec None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:04:45.481399 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-60c9bf44-aa8b-4cd3-8382-5ed8217423b5 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a225f81f16e4cf2a1e62bbb3ec8eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:04:45.482014 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9bf44-aa8b-4cd3-8382-5ed8217423b5 service placement] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:45.482295 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9bf44-aa8b-4cd3-8382-5ed8217423b5 service placement] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:45.482564 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-60c9bf44-aa8b-4cd3-8382-5ed8217423b5 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:45.492074 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9bf44-aa8b-4cd3-8382-5ed8217423b5 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:04:45.493824 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-60c9bf44-aa8b-4cd3-8382-5ed8217423b5 service placement] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:04:45.504727 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 758/1524] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:04:45 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:04:45.978857 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536b1a4-fbae-4c16-a1ca-89c4a58bccc5 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:45.979467 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536b1a4-fbae-4c16-a1ca-89c4a58bccc5 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:45.979467 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7536b1a4-fbae-4c16-a1ca-89c4a58bccc5 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:45.980774 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 767/1525] 127.0.0.1 () {54 vars in 901 bytes} [Sun Aug 21 01:04:45 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:04:45.986278 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f16b7-dde7-4c8a-ac88-fd824b17db53 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:45.986769 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f16b7-dde7-4c8a-ac88-fd824b17db53 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:45.986918 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a01f16b7-dde7-4c8a-ac88-fd824b17db53 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:46.009384 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-a01f16b7-dde7-4c8a-ac88-fd824b17db53 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:04:46.010608 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a01f16b7-dde7-4c8a-ac88-fd824b17db53 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:46.019452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 759/1526] 127.0.0.1 () {58 vars in 998 bytes} [Sun Aug 21 01:04:45 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:04:46.171222 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536b1a4-fbae-4c16-a1ca-89c4a58bccc5 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:04:46.188752 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7536b1a4-fbae-4c16-a1ca-89c4a58bccc5 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:04:46.195654 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b42cc6d3-9c90-4406-9e77-cf515dd693c3 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:04:46.196302 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cc6d3-9c90-4406-9e77-cf515dd693c3 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:46.196568 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cc6d3-9c90-4406-9e77-cf515dd693c3 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:46.196846 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b42cc6d3-9c90-4406-9e77-cf515dd693c3 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:46.206716 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42cc6d3-9c90-4406-9e77-cf515dd693c3 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:04:46.208375 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b42cc6d3-9c90-4406-9e77-cf515dd693c3 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:04:46.223595 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 768/1527] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:04:46 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:04:50.266990 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787303f0-47ab-4aa0-a9ce-1a35e8f65142 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:50.267595 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787303f0-47ab-4aa0-a9ce-1a35e8f65142 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:50.267595 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-787303f0-47ab-4aa0-a9ce-1a35e8f65142 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:50.268911 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 760/1528] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:04:50 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:04:50.274765 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef91249-e543-4b1c-a8f9-22d6915ed195 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:50.275231 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef91249-e543-4b1c-a8f9-22d6915ed195 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:50.275329 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ef91249-e543-4b1c-a8f9-22d6915ed195 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:50.295035 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-1ef91249-e543-4b1c-a8f9-22d6915ed195 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:04:50.296395 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-1ef91249-e543-4b1c-a8f9-22d6915ed195 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:50.304687 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 769/1529] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:04:50 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:04:50.590648 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787303f0-47ab-4aa0-a9ce-1a35e8f65142 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:04:50.592619 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-787303f0-47ab-4aa0-a9ce-1a35e8f65142 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:50.605492 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:04:50.655858 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-787303f0-47ab-4aa0-a9ce-1a35e8f65142 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:04:50.659751 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b21e104-e319-4e09-b9f5-58ccf82f2d44 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:04:50.660382 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21e104-e319-4e09-b9f5-58ccf82f2d44 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:50.660648 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21e104-e319-4e09-b9f5-58ccf82f2d44 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:50.660924 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b21e104-e319-4e09-b9f5-58ccf82f2d44 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:50.671660 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21e104-e319-4e09-b9f5-58ccf82f2d44 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:04:50.673164 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b21e104-e319-4e09-b9f5-58ccf82f2d44 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:04:50.684070 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 761/1530] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:04:50 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 94 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:04:52.574672 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90afd85-f7e0-4abf-8975-9d9c6b51e4c6 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:52.575270 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90afd85-f7e0-4abf-8975-9d9c6b51e4c6 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:52.575270 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c90afd85-f7e0-4abf-8975-9d9c6b51e4c6 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:52.576527 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 770/1531] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:04:52 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:04:52.582475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3fb95-eb34-450a-b551-167dc7817a60 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:52.582982 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3fb95-eb34-450a-b551-167dc7817a60 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:52.582982 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-91f3fb95-eb34-450a-b551-167dc7817a60 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:52.603591 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-91f3fb95-eb34-450a-b551-167dc7817a60 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:04:52.604849 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-91f3fb95-eb34-450a-b551-167dc7817a60 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:52.613430 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 762/1532] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:04:52 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:04:52.894435 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90afd85-f7e0-4abf-8975-9d9c6b51e4c6 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:04:52.896217 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-c90afd85-f7e0-4abf-8975-9d9c6b51e4c6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:52.910274 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c90afd85-f7e0-4abf-8975-9d9c6b51e4c6 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:04:52.914223 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e2dfffac-d79f-4357-8db3-bd90d7852345 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:04:52.914844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfffac-d79f-4357-8db3-bd90d7852345 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:52.915123 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfffac-d79f-4357-8db3-bd90d7852345 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:52.915394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e2dfffac-d79f-4357-8db3-bd90d7852345 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:52.925346 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dfffac-d79f-4357-8db3-bd90d7852345 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:04:52.926815 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e2dfffac-d79f-4357-8db3-bd90d7852345 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:04:52.937261 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 771/1533] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:04:52 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:04:56.432563 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c210bf3-9150-4d93-8f21-447613dee477 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:56.433217 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c210bf3-9150-4d93-8f21-447613dee477 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:56.433217 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7c210bf3-9150-4d93-8f21-447613dee477 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:56.434444 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 763/1534] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:04:56 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:04:56.440757 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7ec51-656d-463c-990d-07d0b0cd9417 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:56.441473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7ec51-656d-463c-990d-07d0b0cd9417 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:56.441473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66a7ec51-656d-463c-990d-07d0b0cd9417 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:56.468794 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-66a7ec51-656d-463c-990d-07d0b0cd9417 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:04:56.470443 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-66a7ec51-656d-463c-990d-07d0b0cd9417 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:56.479458 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 772/1535] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:04:56 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:04:57.061296 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c210bf3-9150-4d93-8f21-447613dee477 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:04:57.063345 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-7c210bf3-9150-4d93-8f21-447613dee477 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:57.125062 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7c210bf3-9150-4d93-8f21-447613dee477 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:04:57.129335 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-4d8e3ff4-05e1-46ff-bff0-c30788cf8c53 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67305d6f08d64f8ba39abe10bd4974c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:04:57.130098 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e3ff4-05e1-46ff-bff0-c30788cf8c53 service cinder] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:57.130371 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e3ff4-05e1-46ff-bff0-c30788cf8c53 service cinder] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:57.130636 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-4d8e3ff4-05e1-46ff-bff0-c30788cf8c53 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:57.140520 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e3ff4-05e1-46ff-bff0-c30788cf8c53 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:04:57.141977 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-4d8e3ff4-05e1-46ff-bff0-c30788cf8c53 service cinder] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:04:57.152034 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 764/1536] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:04:57 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 91 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:04:59.149060 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fb285-5131-4143-8207-059328d93503 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:59.149653 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fb285-5131-4143-8207-059328d93503 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:59.149653 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-273fb285-5131-4143-8207-059328d93503 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:59.150985 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 773/1537] 127.0.0.1 () {54 vars in 917 bytes} [Sun Aug 21 01:04:59 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:04:59.156673 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb102aae-9504-4251-bcc7-08f48ff7dc4d None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:59.157349 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb102aae-9504-4251-bcc7-08f48ff7dc4d None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:59.157349 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fb102aae-9504-4251-bcc7-08f48ff7dc4d None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:59.178717 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-fb102aae-9504-4251-bcc7-08f48ff7dc4d None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:04:59.179963 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-fb102aae-9504-4251-bcc7-08f48ff7dc4d None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:59.189204 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 765/1538] 127.0.0.1 () {58 vars in 1014 bytes} [Sun Aug 21 01:04:59 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 34 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:04:59.743019 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fb285-5131-4143-8207-059328d93503 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:04:59.744782 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-273fb285-5131-4143-8207-059328d93503 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:04:59.759039 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-273fb285-5131-4143-8207-059328d93503 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:04:59.763051 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-08176644-68f4-4f9b-acd5-8e6093834515 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67305d6f08d64f8ba39abe10bd4974c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:04:59.763681 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08176644-68f4-4f9b-acd5-8e6093834515 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:04:59.763952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08176644-68f4-4f9b-acd5-8e6093834515 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:04:59.764215 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-08176644-68f4-4f9b-acd5-8e6093834515 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:04:59.774715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08176644-68f4-4f9b-acd5-8e6093834515 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:04:59.776008 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-08176644-68f4-4f9b-acd5-8e6093834515 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:04:59.786387 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 774/1539] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:04:59 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 44 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:05:09.172060 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=54 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:05:09.781907 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=33 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:17.988425 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a152a48-eafa-4c41-8360-b851d0d65484 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:17.989097 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a152a48-eafa-4c41-8360-b851d0d65484 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:17.989097 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6a152a48-eafa-4c41-8360-b851d0d65484 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:17.995058 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689ed36-ec9a-436a-8343-03a7ce70656e None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:17.995801 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689ed36-ec9a-436a-8343-03a7ce70656e None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:17.995801 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d689ed36-ec9a-436a-8343-03a7ce70656e None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:18.010105 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-6a152a48-eafa-4c41-8360-b851d0d65484 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:18.011517 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6a152a48-eafa-4c41-8360-b851d0d65484 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:18.016080 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-d689ed36-ec9a-436a-8343-03a7ce70656e None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:18.017292 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-d689ed36-ec9a-436a-8343-03a7ce70656e None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:18.023912 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 766/1540] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 21 01:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:18.025598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 775/1541] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 21 01:06:17 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:06:18.034113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34906d57-50ca-4f71-8496-dd4b07576a14 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:18.034409 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34906d57-50ca-4f71-8496-dd4b07576a14 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:18.034684 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-34906d57-50ca-4f71-8496-dd4b07576a14 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:18.034894 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cfd13-235f-427b-b837-eb307f0b2cb1 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:18.035177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cfd13-235f-427b-b837-eb307f0b2cb1 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:18.035445 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-529cfd13-235f-427b-b837-eb307f0b2cb1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:18.055665 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-529cfd13-235f-427b-b837-eb307f0b2cb1 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:18.056893 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-529cfd13-235f-427b-b837-eb307f0b2cb1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:18.059748 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-34906d57-50ca-4f71-8496-dd4b07576a14 None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:18.060939 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-34906d57-50ca-4f71-8496-dd4b07576a14 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:18.068972 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 776/1542] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 21 01:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:18.069837 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 767/1543] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 21 01:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:18.074108 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34906d57-50ca-4f71-8496-dd4b07576a14 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:18.074361 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529cfd13-235f-427b-b837-eb307f0b2cb1 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:18.083807 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-34906d57-50ca-4f71-8496-dd4b07576a14 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:18.086322 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-529cfd13-235f-427b-b837-eb307f0b2cb1 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:18.088787 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97631a-1725-4b0b-b053-8a5060a26ad5 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:18.089413 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97631a-1725-4b0b-b053-8a5060a26ad5 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:18.089789 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97631a-1725-4b0b-b053-8a5060a26ad5 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:18.090069 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3f97631a-1725-4b0b-b053-8a5060a26ad5 admin admin] PATH_INFO: `/v3/domains` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:18.090725 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97631a-1725-4b0b-b053-8a5060a26ad5 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81577) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:06:18.091022 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97631a-1725-4b0b-b053-8a5060a26ad5 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:18.091678 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ce9ee-e907-419b-a812-6521e0a70d35 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:18.092282 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ce9ee-e907-419b-a812-6521e0a70d35 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:18.092556 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ce9ee-e907-419b-a812-6521e0a70d35 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:18.092663 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3f97631a-1725-4b0b-b053-8a5060a26ad5 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:18.092824 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4ce9ee-e907-419b-a812-6521e0a70d35 admin admin] PATH_INFO: `/v3/domains` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:18.093500 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ce9ee-e907-419b-a812-6521e0a70d35 admin admin] RBAC: Adding query filter params (name=Default) {{(pid=81578) _extract_filter_values /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:167}} Aug 21 01:06:18.093805 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ce9ee-e907-419b-a812-6521e0a70d35 admin admin] RBAC: Authorizing `identity:list_domains()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:18.094903 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: WARNING py.warnings [None req-ff4ce9ee-e907-419b-a812-6521e0a70d35 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:list_domains": "role:reader and system_scope:all" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:18.094903 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: warnings.warn(msg) Aug 21 01:06:18.094903 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: Aug 21 01:06:18.095780 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4ce9ee-e907-419b-a812-6521e0a70d35 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:18.106056 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 768/1544] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 21 01:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 177 bytes (1 switches on core 0) Aug 21 01:06:18.108658 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 777/1545] 10.222.0.49 () {58 vars in 1153 bytes} [Sun Aug 21 01:06:18 2022] GET /identity/v3/domains?name=Default => generated 308 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 177 bytes (2 switches on core 0) Aug 21 01:06:18.114207 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97631a-1725-4b0b-b053-8a5060a26ad5 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:18.117085 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ce9ee-e907-419b-a812-6521e0a70d35 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:18.125420 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3f97631a-1725-4b0b-b053-8a5060a26ad5 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:18.127815 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4ce9ee-e907-419b-a812-6521e0a70d35 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:18.131366 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef39c4-87c3-4d0a-85d8-c9f2434724eb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:18.131974 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef39c4-87c3-4d0a-85d8-c9f2434724eb admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:18.132246 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef39c4-87c3-4d0a-85d8-c9f2434724eb admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:18.132511 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-46ef39c4-87c3-4d0a-85d8-c9f2434724eb admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:18.133161 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef39c4-87c3-4d0a-85d8-c9f2434724eb admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:18.133967 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352a0d8-c1fa-4752-ae8b-8b7120fae56a admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:18.134172 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: WARNING py.warnings [None req-46ef39c4-87c3-4d0a-85d8-c9f2434724eb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:18.134172 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: warnings.warn(msg) Aug 21 01:06:18.134172 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: Aug 21 01:06:18.134592 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352a0d8-c1fa-4752-ae8b-8b7120fae56a admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:18.134994 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352a0d8-c1fa-4752-ae8b-8b7120fae56a admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:18.135127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8352a0d8-c1fa-4752-ae8b-8b7120fae56a admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:18.135375 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-46ef39c4-87c3-4d0a-85d8-c9f2434724eb admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:18.135747 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8352a0d8-c1fa-4752-ae8b-8b7120fae56a admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:18.137777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8352a0d8-c1fa-4752-ae8b-8b7120fae56a admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:18.177100 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 769/1546] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:18 2022] POST /identity/v3/projects => generated 375 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:18.180274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef39c4-87c3-4d0a-85d8-c9f2434724eb admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:18.181100 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 778/1547] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:18 2022] POST /identity/v3/projects => generated 383 bytes in 62 msecs (HTTP/1.1 201) 5 headers in 182 bytes (2 switches on core 0) Aug 21 01:06:18.183086 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352a0d8-c1fa-4752-ae8b-8b7120fae56a admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:18.250113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-46ef39c4-87c3-4d0a-85d8-c9f2434724eb admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:18.250743 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8352a0d8-c1fa-4752-ae8b-8b7120fae56a admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:18.255192 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9578c-72cd-4bf9-993a-5eead9994fe6 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:18.255808 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9578c-72cd-4bf9-993a-5eead9994fe6 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:18.256087 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9578c-72cd-4bf9-993a-5eead9994fe6 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:18.256297 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567fa05-d7cb-4619-83ae-418552444f60 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:18.256428 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a3b9578c-72cd-4bf9-993a-5eead9994fe6 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:18.256973 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9578c-72cd-4bf9-993a-5eead9994fe6 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:18.257133 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567fa05-d7cb-4619-83ae-418552444f60 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:18.257426 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567fa05-d7cb-4619-83ae-418552444f60 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:18.257750 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0567fa05-d7cb-4619-83ae-418552444f60 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:18.258598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567fa05-d7cb-4619-83ae-418552444f60 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:18.258908 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a3b9578c-72cd-4bf9-993a-5eead9994fe6 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:18.259780 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: WARNING py.warnings [None req-0567fa05-d7cb-4619-83ae-418552444f60 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:18.259780 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: warnings.warn(msg) Aug 21 01:06:18.259780 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: Aug 21 01:06:18.261428 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-0567fa05-d7cb-4619-83ae-418552444f60 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:18.282953 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 770/1548] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:18 2022] POST /identity/v3/users => generated 288 bytes in 103 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:18.283869 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 779/1549] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:18 2022] POST /identity/v3/users => generated 292 bytes in 101 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:18.287487 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9578c-72cd-4bf9-993a-5eead9994fe6 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:18.287640 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567fa05-d7cb-4619-83ae-418552444f60 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:18.298239 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0567fa05-d7cb-4619-83ae-418552444f60 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:18.298470 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a3b9578c-72cd-4bf9-993a-5eead9994fe6 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:18.303642 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecb918-c075-4c08-8e32-478f8beb5ac3 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:18.303803 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445b7f3-4cde-4dbd-9176-d0b8ac54ea24 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:18.304352 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecb918-c075-4c08-8e32-478f8beb5ac3 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:18.304546 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445b7f3-4cde-4dbd-9176-d0b8ac54ea24 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:18.304689 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecb918-c075-4c08-8e32-478f8beb5ac3 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:18.304775 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445b7f3-4cde-4dbd-9176-d0b8ac54ea24 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:18.304964 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-62ecb918-c075-4c08-8e32-478f8beb5ac3 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:18.305103 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f445b7f3-4cde-4dbd-9176-d0b8ac54ea24 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:18.305609 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecb918-c075-4c08-8e32-478f8beb5ac3 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:18.305747 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445b7f3-4cde-4dbd-9176-d0b8ac54ea24 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:18.307220 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-f445b7f3-4cde-4dbd-9176-d0b8ac54ea24 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:18.307337 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-62ecb918-c075-4c08-8e32-478f8beb5ac3 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:18.318542 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 780/1550] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:18.322171 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 771/1551] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 35 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:18.322781 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecb918-c075-4c08-8e32-478f8beb5ac3 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:18.323075 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445b7f3-4cde-4dbd-9176-d0b8ac54ea24 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:18.335247 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f445b7f3-4cde-4dbd-9176-d0b8ac54ea24 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:18.337477 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-62ecb918-c075-4c08-8e32-478f8beb5ac3 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:18.338369 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90568482-ea51-4bfd-aaa0-247d2b6945fc admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:18.338510 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb0a71-324a-4ea0-a380-e81c624004af admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:18.338879 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90568482-ea51-4bfd-aaa0-247d2b6945fc admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:18.338997 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb0a71-324a-4ea0-a380-e81c624004af admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:18.339151 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb0a71-324a-4ea0-a380-e81c624004af admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:18.339249 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90568482-ea51-4bfd-aaa0-247d2b6945fc admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:18.339419 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-90568482-ea51-4bfd-aaa0-247d2b6945fc admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:18.339517 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-82fb0a71-324a-4ea0-a380-e81c624004af admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:18.340169 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb0a71-324a-4ea0-a380-e81c624004af admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:18.340283 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90568482-ea51-4bfd-aaa0-247d2b6945fc admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:18.341825 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-90568482-ea51-4bfd-aaa0-247d2b6945fc admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:18.341959 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-82fb0a71-324a-4ea0-a380-e81c624004af admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:18.353533 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 772/1552] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 31 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:18.357642 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 781/1553] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:18 2022] GET /identity/v3/roles => generated 1420 bytes in 32 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:18.357824 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90568482-ea51-4bfd-aaa0-247d2b6945fc admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:18.358906 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb0a71-324a-4ea0-a380-e81c624004af admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:18.369166 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-90568482-ea51-4bfd-aaa0-247d2b6945fc admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:18.371859 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-82fb0a71-324a-4ea0-a380-e81c624004af admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:18.375220 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-32966900-a3f0-41f3-815a-faf28b2fcd87 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:18.375220 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32966900-a3f0-41f3-815a-faf28b2fcd87 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:18.375220 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32966900-a3f0-41f3-815a-faf28b2fcd87 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:18.375558 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-32966900-a3f0-41f3-815a-faf28b2fcd87 admin admin] PATH_INFO: `/v3/projects/bf67ac1745584a51bd12525ecd676221/users/41864937ad9d47688b054e39744cd180/roles/54545d831b9e469dad64f2d28c12e462` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:18.377029 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dedc2409-20cd-4af4-af69-77ae2fce8b03 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:18.377737 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc2409-20cd-4af4-af69-77ae2fce8b03 admin admin] REQUEST_METHOD: `PUT` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:18.378012 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc2409-20cd-4af4-af69-77ae2fce8b03 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:18.378282 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dedc2409-20cd-4af4-af69-77ae2fce8b03 admin admin] PATH_INFO: `/v3/projects/11f9354b5a54458086eafbe74b85b744/users/f599b0676c2241b88e7192223f5cee5b/roles/54545d831b9e469dad64f2d28c12e462` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:18.391266 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32966900-a3f0-41f3-815a-faf28b2fcd87 admin admin] RBAC: Authorizing `identity:create_grant(project_id=bf67ac1745584a51bd12525ecd676221, user_id=41864937ad9d47688b054e39744cd180, role_id=54545d831b9e469dad64f2d28c12e462)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:18.392308 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: WARNING py.warnings [None req-32966900-a3f0-41f3-815a-faf28b2fcd87 admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:create_grant": "(role:admin and system_scope:all) or ((role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.user.domain_id)s and domain_id:%(target.domain.id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.project.domain_id)s) or (role:admin and domain_id:%(target.group.domain_id)s and domain_id:%(target.domain.id)s)) and (domain_id:%(target.role.domain_id)s or None:%(target.role.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:06:18.392308 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: warnings.warn(msg) Aug 21 01:06:18.392308 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: Aug 21 01:06:18.394299 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-32966900-a3f0-41f3-815a-faf28b2fcd87 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:18.405662 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc2409-20cd-4af4-af69-77ae2fce8b03 admin admin] RBAC: Authorizing `identity:create_grant(project_id=11f9354b5a54458086eafbe74b85b744, user_id=f599b0676c2241b88e7192223f5cee5b, role_id=54545d831b9e469dad64f2d28c12e462)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:18.409290 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 773/1554] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:18 2022] PUT /identity/v3/projects/bf67ac1745584a51bd12525ecd676221/users/41864937ad9d47688b054e39744cd180/roles/54545d831b9e469dad64f2d28c12e462 => generated 0 bytes in 52 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:06:18.410055 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dedc2409-20cd-4af4-af69-77ae2fce8b03 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:18.414856 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c01fec-75a1-4de6-89c5-d9ba8808d4ad None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:18.415161 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c01fec-75a1-4de6-89c5-d9ba8808d4ad None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:18.415434 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-59c01fec-75a1-4de6-89c5-d9ba8808d4ad None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:18.428428 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 782/1555] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:18 2022] PUT /identity/v3/projects/11f9354b5a54458086eafbe74b85b744/users/f599b0676c2241b88e7192223f5cee5b/roles/54545d831b9e469dad64f2d28c12e462 => generated 0 bytes in 70 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:18.435590 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c27f3e-72f6-43d0-b073-9b40f707f9af None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:18.436012 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c27f3e-72f6-43d0-b073-9b40f707f9af None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:18.436450 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f3c27f3e-72f6-43d0-b073-9b40f707f9af None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:18.436803 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-59c01fec-75a1-4de6-89c5-d9ba8808d4ad None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:18.438134 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-59c01fec-75a1-4de6-89c5-d9ba8808d4ad None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:18.459845 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-f3c27f3e-72f6-43d0-b073-9b40f707f9af None None] MFA Rules not processed for user `bab4a9bddb7141a48bb694677f33efcc`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:18.461099 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-f3c27f3e-72f6-43d0-b073-9b40f707f9af None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:18.482578 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:18.504266 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 774/1556] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 21 01:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 90 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:06:18.510374 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=95,keystone:INSERT=5 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:18.516013 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c01fec-75a1-4de6-89c5-d9ba8808d4ad None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:18.530963 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 783/1557] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 21 01:06:18 2022] POST /identity/v3/auth/tokens => generated 3239 bytes in 97 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:06:18.541127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c27f3e-72f6-43d0-b073-9b40f707f9af None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:18.579852 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-59c01fec-75a1-4de6-89c5-d9ba8808d4ad None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:18.583817 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1ab0c604-429a-4b67-8523-3f76bff55f29 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:18.584439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0c604-429a-4b67-8523-3f76bff55f29 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:18.584729 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0c604-429a-4b67-8523-3f76bff55f29 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:18.584987 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1ab0c604-429a-4b67-8523-3f76bff55f29 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:18.595347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0c604-429a-4b67-8523-3f76bff55f29 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:18.596960 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1ab0c604-429a-4b67-8523-3f76bff55f29 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:18.599054 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-f3c27f3e-72f6-43d0-b073-9b40f707f9af None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:18.602904 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c5c2887a-da4e-46e7-b8a1-9e0965e7690b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:18.603513 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2887a-da4e-46e7-b8a1-9e0965e7690b service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:18.603784 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2887a-da4e-46e7-b8a1-9e0965e7690b service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:18.604042 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c5c2887a-da4e-46e7-b8a1-9e0965e7690b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:18.607151 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 775/1558] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 92 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:06:18.613931 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2887a-da4e-46e7-b8a1-9e0965e7690b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:18.615887 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c5c2887a-da4e-46e7-b8a1-9e0965e7690b service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:18.627606 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 784/1559] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:18 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 87 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:06:24.960899 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42ca21-2b2e-446a-955e-302ede0a0913 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:24.961328 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42ca21-2b2e-446a-955e-302ede0a0913 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:24.961328 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3e42ca21-2b2e-446a-955e-302ede0a0913 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:25.016355 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-3e42ca21-2b2e-446a-955e-302ede0a0913 None None] MFA Rules not processed for user `41864937ad9d47688b054e39744cd180`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:25.017767 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-3e42ca21-2b2e-446a-955e-302ede0a0913 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:25.135649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c68271-c652-4445-8690-2ffdd0f78b83 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:25.136649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c68271-c652-4445-8690-2ffdd0f78b83 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:25.137232 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-87c68271-c652-4445-8690-2ffdd0f78b83 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:25.169275 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 776/1560] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 21 01:06:24 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 208 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:25.172019 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42ca21-2b2e-446a-955e-302ede0a0913 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:25.185946 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3e42ca21-2b2e-446a-955e-302ede0a0913 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:25.191268 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c4673-3b70-41b3-ba9c-d75870c3cc0e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:25.191966 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c4673-3b70-41b3-ba9c-d75870c3cc0e admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:25.192348 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c4673-3b70-41b3-ba9c-d75870c3cc0e admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:25.192541 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-87c68271-c652-4445-8690-2ffdd0f78b83 None None] MFA Rules not processed for user `f599b0676c2241b88e7192223f5cee5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:25.192658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c42c4673-3b70-41b3-ba9c-d75870c3cc0e admin admin] PATH_INFO: `/v3/projects` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:25.193307 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c4673-3b70-41b3-ba9c-d75870c3cc0e admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:25.194167 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-87c68271-c652-4445-8690-2ffdd0f78b83 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:25.195327 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c42c4673-3b70-41b3-ba9c-d75870c3cc0e admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:25.245257 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 777/1561] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:25 2022] POST /identity/v3/projects => generated 379 bytes in 74 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:25.246299 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c4673-3b70-41b3-ba9c-d75870c3cc0e admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:25.302238 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 785/1562] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 21 01:06:25 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 168 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:06:25.307289 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c68271-c652-4445-8690-2ffdd0f78b83 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:25.327206 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-87c68271-c652-4445-8690-2ffdd0f78b83 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:25.340926 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:25.345594 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c42c4673-3b70-41b3-ba9c-d75870c3cc0e admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:25.353633 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727a3b2-61fd-4298-9112-51d99d9e9516 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:25.355365 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727a3b2-61fd-4298-9112-51d99d9e9516 admin admin] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:25.355365 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727a3b2-61fd-4298-9112-51d99d9e9516 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:25.355559 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5727a3b2-61fd-4298-9112-51d99d9e9516 admin admin] PATH_INFO: `/v3/users` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:25.356212 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727a3b2-61fd-4298-9112-51d99d9e9516 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:25.359837 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5727a3b2-61fd-4298-9112-51d99d9e9516 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:25.389403 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 778/1563] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:25 2022] POST /identity/v3/users => generated 296 bytes in 144 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:25.394250 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727a3b2-61fd-4298-9112-51d99d9e9516 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:25.410341 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65954799-7028-40db-a8c5-66ebcc9c0411 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:25.411260 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65954799-7028-40db-a8c5-66ebcc9c0411 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:25.411475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5727a3b2-61fd-4298-9112-51d99d9e9516 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:25.411666 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65954799-7028-40db-a8c5-66ebcc9c0411 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:25.412009 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-65954799-7028-40db-a8c5-66ebcc9c0411 admin admin] PATH_INFO: `/v3/projects` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:25.412727 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65954799-7028-40db-a8c5-66ebcc9c0411 admin admin] RBAC: Authorizing `identity:create_project()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:25.415300 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-65954799-7028-40db-a8c5-66ebcc9c0411 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:25.417202 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f066f5d-e534-4eba-9768-a74dcbfbd025 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:25.417870 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f066f5d-e534-4eba-9768-a74dcbfbd025 admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:25.418187 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f066f5d-e534-4eba-9768-a74dcbfbd025 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:25.418413 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5f066f5d-e534-4eba-9768-a74dcbfbd025 admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:25.419086 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f066f5d-e534-4eba-9768-a74dcbfbd025 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:25.420715 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5f066f5d-e534-4eba-9768-a74dcbfbd025 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:25.433124 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 779/1564] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 39 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:25.438349 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f066f5d-e534-4eba-9768-a74dcbfbd025 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:25.454838 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5f066f5d-e534-4eba-9768-a74dcbfbd025 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:25.460452 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 786/1565] 10.222.0.49 () {60 vars in 1153 bytes} [Sun Aug 21 01:06:25 2022] POST /identity/v3/projects => generated 381 bytes in 153 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:25.461789 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78198513-f89f-4c10-975d-29bf7b567697 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:25.462666 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78198513-f89f-4c10-975d-29bf7b567697 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:25.463164 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78198513-f89f-4c10-975d-29bf7b567697 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:25.463598 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-78198513-f89f-4c10-975d-29bf7b567697 admin admin] PATH_INFO: `/v3/projects/96a839777ead420ea7022c98c627d538/users/ed2c646eb90743e0bf3cc427d28f0d72/roles/c73e9539582145ed8eedc48648b9d738` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:25.464667 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65954799-7028-40db-a8c5-66ebcc9c0411 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:25.472121 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=99,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:25.490206 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78198513-f89f-4c10-975d-29bf7b567697 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a839777ead420ea7022c98c627d538, user_id=ed2c646eb90743e0bf3cc427d28f0d72, role_id=c73e9539582145ed8eedc48648b9d738)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:25.494048 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-78198513-f89f-4c10-975d-29bf7b567697 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:25.516011 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 780/1566] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:25 2022] PUT /identity/v3/projects/96a839777ead420ea7022c98c627d538/users/ed2c646eb90743e0bf3cc427d28f0d72/roles/c73e9539582145ed8eedc48648b9d738 => generated 0 bytes in 76 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:25.518331 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78198513-f89f-4c10-975d-29bf7b567697 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:25.560805 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-65954799-7028-40db-a8c5-66ebcc9c0411 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:25.606668 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-78198513-f89f-4c10-975d-29bf7b567697 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:25.612601 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897fe95-d0ad-44b0-b9d3-61c39823900d admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:25.613648 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897fe95-d0ad-44b0-b9d3-61c39823900d admin admin] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:25.614141 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897fe95-d0ad-44b0-b9d3-61c39823900d admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:25.614694 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1897fe95-d0ad-44b0-b9d3-61c39823900d admin admin] PATH_INFO: `/v3/roles` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:25.615927 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897fe95-d0ad-44b0-b9d3-61c39823900d admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:25.617846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1897fe95-d0ad-44b0-b9d3-61c39823900d admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:25.633380 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 781/1567] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 114 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:25.634847 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897fe95-d0ad-44b0-b9d3-61c39823900d admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:25.648118 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce43c0-07b1-4e35-af56-b7c290268988 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:25.649105 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1897fe95-d0ad-44b0-b9d3-61c39823900d admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:25.649268 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce43c0-07b1-4e35-af56-b7c290268988 admin admin] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:25.649268 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce43c0-07b1-4e35-af56-b7c290268988 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:25.649452 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d6ce43c0-07b1-4e35-af56-b7c290268988 admin admin] PATH_INFO: `/v3/users` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:25.649920 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce43c0-07b1-4e35-af56-b7c290268988 admin admin] RBAC: Authorizing `identity:create_user()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:25.652183 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d6ce43c0-07b1-4e35-af56-b7c290268988 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:25.662980 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a291e0b-0426-4918-8810-42af47da66d2 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:25.665338 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a291e0b-0426-4918-8810-42af47da66d2 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:25.665831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a291e0b-0426-4918-8810-42af47da66d2 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:25.666202 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7a291e0b-0426-4918-8810-42af47da66d2 admin admin] PATH_INFO: `/v3/projects/96a839777ead420ea7022c98c627d538/users/ed2c646eb90743e0bf3cc427d28f0d72/roles/c73e9539582145ed8eedc48648b9d738` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:25.668983 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a291e0b-0426-4918-8810-42af47da66d2 admin admin] RBAC: Authorizing `identity:create_grant(project_id=96a839777ead420ea7022c98c627d538, user_id=ed2c646eb90743e0bf3cc427d28f0d72, role_id=c73e9539582145ed8eedc48648b9d738)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:25.675617 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7a291e0b-0426-4918-8810-42af47da66d2 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:25.683791 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 787/1568] 10.222.0.49 () {60 vars in 1144 bytes} [Sun Aug 21 01:06:25 2022] POST /identity/v3/users => generated 297 bytes in 220 msecs (HTTP/1.1 201) 5 headers in 182 bytes (1 switches on core 0) Aug 21 01:06:25.688673 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce43c0-07b1-4e35-af56-b7c290268988 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:25.701111 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 782/1569] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:25 2022] PUT /identity/v3/projects/96a839777ead420ea7022c98c627d538/users/ed2c646eb90743e0bf3cc427d28f0d72/roles/c73e9539582145ed8eedc48648b9d738 => generated 0 bytes in 65 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:06:25.720473 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d6ce43c0-07b1-4e35-af56-b7c290268988 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:25.846099 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a07734-a84f-4d1a-b8d9-d6ace1ea0c78 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:25.847203 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a07734-a84f-4d1a-b8d9-d6ace1ea0c78 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:25.847203 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a07734-a84f-4d1a-b8d9-d6ace1ea0c78 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:25.847698 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-63a07734-a84f-4d1a-b8d9-d6ace1ea0c78 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:25.848533 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a07734-a84f-4d1a-b8d9-d6ace1ea0c78 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:25.855559 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-63a07734-a84f-4d1a-b8d9-d6ace1ea0c78 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:25.884122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 788/1570] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 194 msecs (HTTP/1.1 200) 5 headers in 178 bytes (2 switches on core 0) Aug 21 01:06:25.886212 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a291e0b-0426-4918-8810-42af47da66d2 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:25.902308 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7a291e0b-0426-4918-8810-42af47da66d2 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:25.911219 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74897809-8ba1-40f5-9237-0db257386631 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:25.912050 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74897809-8ba1-40f5-9237-0db257386631 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:25.912559 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74897809-8ba1-40f5-9237-0db257386631 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:25.912890 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-74897809-8ba1-40f5-9237-0db257386631 admin admin] PATH_INFO: `/v3/projects/5406cbb1ecd74e7c9cb89e3ad19d3ace/users/059979620bca4d1284a8070c81616429/roles/c73e9539582145ed8eedc48648b9d738` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:25.939435 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74897809-8ba1-40f5-9237-0db257386631 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5406cbb1ecd74e7c9cb89e3ad19d3ace, user_id=059979620bca4d1284a8070c81616429, role_id=c73e9539582145ed8eedc48648b9d738)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:25.945319 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-74897809-8ba1-40f5-9237-0db257386631 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:25.973420 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 783/1571] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:25 2022] PUT /identity/v3/projects/5406cbb1ecd74e7c9cb89e3ad19d3ace/users/059979620bca4d1284a8070c81616429/roles/c73e9539582145ed8eedc48648b9d738 => generated 0 bytes in 88 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:25.983144 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a07734-a84f-4d1a-b8d9-d6ace1ea0c78 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:25.999452 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-63a07734-a84f-4d1a-b8d9-d6ace1ea0c78 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:26.058254 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=97,keystone:INSERT=3 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:26.089034 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fad5a1a1-b87e-4af5-ae8e-eac2ba0193e8 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:26.092666 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5a1a1-b87e-4af5-ae8e-eac2ba0193e8 admin admin] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:26.093156 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5a1a1-b87e-4af5-ae8e-eac2ba0193e8 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:26.093572 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fad5a1a1-b87e-4af5-ae8e-eac2ba0193e8 admin admin] PATH_INFO: `/v3/roles` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:26.094433 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5a1a1-b87e-4af5-ae8e-eac2ba0193e8 admin admin] RBAC: Authorizing `identity:list_roles()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:26.096343 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fad5a1a1-b87e-4af5-ae8e-eac2ba0193e8 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:26.111615 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 789/1572] 10.222.0.49 () {58 vars in 1122 bytes} [Sun Aug 21 01:06:25 2022] GET /identity/v3/roles => generated 1420 bytes in 133 msecs (HTTP/1.1 200) 5 headers in 178 bytes (1 switches on core 0) Aug 21 01:06:26.112807 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74897809-8ba1-40f5-9237-0db257386631 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:26.136593 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-74897809-8ba1-40f5-9237-0db257386631 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:26.150395 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aff4db-70d1-43b2-bca5-701cb82a1860 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:26.151104 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aff4db-70d1-43b2-bca5-701cb82a1860 admin admin] REQUEST_METHOD: `PUT` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:26.151438 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aff4db-70d1-43b2-bca5-701cb82a1860 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:26.151880 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-93aff4db-70d1-43b2-bca5-701cb82a1860 admin admin] PATH_INFO: `/v3/projects/5406cbb1ecd74e7c9cb89e3ad19d3ace/users/059979620bca4d1284a8070c81616429/roles/c73e9539582145ed8eedc48648b9d738` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:26.153939 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aff4db-70d1-43b2-bca5-701cb82a1860 admin admin] RBAC: Authorizing `identity:create_grant(project_id=5406cbb1ecd74e7c9cb89e3ad19d3ace, user_id=059979620bca4d1284a8070c81616429, role_id=c73e9539582145ed8eedc48648b9d738)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:26.156943 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-93aff4db-70d1-43b2-bca5-701cb82a1860 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:26.170473 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 784/1573] 10.222.0.49 () {60 vars in 1483 bytes} [Sun Aug 21 01:06:26 2022] PUT /identity/v3/projects/5406cbb1ecd74e7c9cb89e3ad19d3ace/users/059979620bca4d1284a8070c81616429/roles/c73e9539582145ed8eedc48648b9d738 => generated 0 bytes in 58 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:06:31.844913 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef6fcb-752d-45d9-ab2f-a3cb71790b90 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:31.845630 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef6fcb-752d-45d9-ab2f-a3cb71790b90 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:31.846127 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1fef6fcb-752d-45d9-ab2f-a3cb71790b90 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:31.890217 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-1fef6fcb-752d-45d9-ab2f-a3cb71790b90 None None] MFA Rules not processed for user `ed2c646eb90743e0bf3cc427d28f0d72`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:31.891507 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-1fef6fcb-752d-45d9-ab2f-a3cb71790b90 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:32.001292 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 790/1574] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 21 01:06:31 2022] POST /identity/v3/auth/tokens => generated 3323 bytes in 157 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:32.018454 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aff4db-70d1-43b2-bca5-701cb82a1860 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:32.022545 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-93aff4db-70d1-43b2-bca5-701cb82a1860 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:32.162686 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=93,keystone:INSERT=7 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:32.213712 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-93aff4db-70d1-43b2-bca5-701cb82a1860 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:32.235490 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb631e-ad04-4161-b22b-e8ce01e70828 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77362a2134af4ede855882c58f40c472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:32.251007 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb631e-ad04-4161-b22b-e8ce01e70828 service glance] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:32.251007 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb631e-ad04-4161-b22b-e8ce01e70828 service glance] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:32.251007 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-67eb631e-ad04-4161-b22b-e8ce01e70828 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:32.432421 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb631e-ad04-4161-b22b-e8ce01e70828 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:32.435071 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-67eb631e-ad04-4161-b22b-e8ce01e70828 service glance] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:32.458728 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 785/1575] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:32 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 440 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:32.834865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be04336-80ad-4c87-8c40-7181da68d859 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:32.835278 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be04336-80ad-4c87-8c40-7181da68d859 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:32.835654 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1be04336-80ad-4c87-8c40-7181da68d859 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:32.886914 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-1be04336-80ad-4c87-8c40-7181da68d859 None None] MFA Rules not processed for user `059979620bca4d1284a8070c81616429`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:32.889182 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-1be04336-80ad-4c87-8c40-7181da68d859 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:33.011286 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 791/1576] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 21 01:06:32 2022] POST /identity/v3/auth/tokens => generated 3325 bytes in 178 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:33.023880 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb631e-ad04-4161-b22b-e8ce01e70828 service glance] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:33.036020 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-67eb631e-ad04-4161-b22b-e8ce01e70828 service glance] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:33.040174 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339eef55-a49c-42ba-be3d-7a27d7672fec service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77362a2134af4ede855882c58f40c472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:33.040726 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339eef55-a49c-42ba-be3d-7a27d7672fec service glance] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:33.041220 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339eef55-a49c-42ba-be3d-7a27d7672fec service glance] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:33.041673 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-339eef55-a49c-42ba-be3d-7a27d7672fec service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:33.121809 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339eef55-a49c-42ba-be3d-7a27d7672fec service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:33.123708 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-339eef55-a49c-42ba-be3d-7a27d7672fec service glance] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:33.135410 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 786/1577] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:33 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 112 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:33.404427 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01301a87-c93f-4de0-aa15-70d2d6ef3efb None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:33.404711 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01301a87-c93f-4de0-aa15-70d2d6ef3efb None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:33.405011 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01301a87-c93f-4de0-aa15-70d2d6ef3efb None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:33.468289 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-01301a87-c93f-4de0-aa15-70d2d6ef3efb None None] MFA Rules not processed for user `a06f043017114f9090264293f5ede6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:33.471123 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-01301a87-c93f-4de0-aa15-70d2d6ef3efb None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:33.489312 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=100 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:33.583120 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 792/1578] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 21 01:06:33 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 179 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:33.716994 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339eef55-a49c-42ba-be3d-7a27d7672fec service glance] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:33.718452 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-339eef55-a49c-42ba-be3d-7a27d7672fec service glance] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:33.835959 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-339eef55-a49c-42ba-be3d-7a27d7672fec service glance] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:33.841434 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1af43-91c0-40b4-b3bd-f313f77a6c94 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66a877fdca340f48f54b48e5367a194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:33.842083 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1af43-91c0-40b4-b3bd-f313f77a6c94 service swift] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:33.842357 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1af43-91c0-40b4-b3bd-f313f77a6c94 service swift] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:33.842624 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26c1af43-91c0-40b4-b3bd-f313f77a6c94 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:33.855127 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1af43-91c0-40b4-b3bd-f313f77a6c94 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:33.856820 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26c1af43-91c0-40b4-b3bd-f313f77a6c94 service swift] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:33.869208 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=100 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:33.878862 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 787/1579] 10.222.0.49 () {60 vars in 1384 bytes} [Sun Aug 21 01:06:33 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 162 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:06:34.235542 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8fce7-c0d7-4f24-9d38-b58c712c8b54 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:34.236056 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8fce7-c0d7-4f24-9d38-b58c712c8b54 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:34.236056 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-25a8fce7-c0d7-4f24-9d38-b58c712c8b54 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:34.261362 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-25a8fce7-c0d7-4f24-9d38-b58c712c8b54 None None] MFA Rules not processed for user `a06f043017114f9090264293f5ede6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:34.263797 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-25a8fce7-c0d7-4f24-9d38-b58c712c8b54 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:34.274399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 793/1580] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 21 01:06:34 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:34.300571 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1af43-91c0-40b4-b3bd-f313f77a6c94 service swift] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:34.320151 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26c1af43-91c0-40b4-b3bd-f313f77a6c94 service swift] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:34.332227 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-66c78ae8-a775-43ea-ba36-f681786cadc9 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66a877fdca340f48f54b48e5367a194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:34.333426 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c78ae8-a775-43ea-ba36-f681786cadc9 service swift] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:34.334154 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c78ae8-a775-43ea-ba36-f681786cadc9 service swift] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:34.334666 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-66c78ae8-a775-43ea-ba36-f681786cadc9 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:34.351167 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c78ae8-a775-43ea-ba36-f681786cadc9 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:34.352972 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-66c78ae8-a775-43ea-ba36-f681786cadc9 service swift] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:34.364385 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 788/1581] 10.222.0.49 () {60 vars in 1384 bytes} [Sun Aug 21 01:06:34 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 64 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:06:44.254276 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=23 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:44.359558 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=6 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:06:46.771656 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124f952-aab1-46cc-ae69-016a5d08d383 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:46.772580 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124f952-aab1-46cc-ae69-016a5d08d383 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:46.772580 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1124f952-aab1-46cc-ae69-016a5d08d383 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:46.799589 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-1124f952-aab1-46cc-ae69-016a5d08d383 None None] MFA Rules not processed for user `f599b0676c2241b88e7192223f5cee5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:46.802239 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-1124f952-aab1-46cc-ae69-016a5d08d383 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:46.810412 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 794/1582] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 21 01:06:46 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 40 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:47.127274 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0ffb2-b56e-4ff0-b40f-c049620290eb None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:47.128346 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0ffb2-b56e-4ff0-b40f-c049620290eb None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:47.128662 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eed0ffb2-b56e-4ff0-b40f-c049620290eb None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:47.130763 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 789/1583] 10.222.0.49 () {54 vars in 962 bytes} [Sun Aug 21 01:06:47 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:06:47.138281 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad2cf1-3c88-46cf-8cf0-19788b23598c None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:47.138787 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad2cf1-3c88-46cf-8cf0-19788b23598c None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:47.139258 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-31ad2cf1-3c88-46cf-8cf0-19788b23598c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:47.184864 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-31ad2cf1-3c88-46cf-8cf0-19788b23598c None None] MFA Rules not processed for user `6b003ae4a082485ab608bf84c1657159`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:47.186038 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-31ad2cf1-3c88-46cf-8cf0-19788b23598c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:47.310281 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 795/1584] 10.222.0.49 () {58 vars in 1059 bytes} [Sun Aug 21 01:06:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 173 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:47.316384 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7662b-e57b-44b8-8997-5b29c7a90102 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:47.316706 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7662b-e57b-44b8-8997-5b29c7a90102 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:47.317014 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0da7662b-e57b-44b8-8997-5b29c7a90102 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:47.318801 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 790/1585] 10.222.0.49 () {54 vars in 912 bytes} [Sun Aug 21 01:06:47 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:06:47.327750 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1696004-93e7-4f21-9065-2f1f7ce6846f None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:47.328236 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1696004-93e7-4f21-9065-2f1f7ce6846f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:47.328565 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1696004-93e7-4f21-9065-2f1f7ce6846f None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:47.351157 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-f1696004-93e7-4f21-9065-2f1f7ce6846f None None] MFA Rules not processed for user `6b003ae4a082485ab608bf84c1657159`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:47.352588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-f1696004-93e7-4f21-9065-2f1f7ce6846f None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:47.362537 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 796/1586] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 21 01:06:47 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 36 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:47.376461 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7662b-e57b-44b8-8997-5b29c7a90102 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:47.378490 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-0da7662b-e57b-44b8-8997-5b29c7a90102 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:47.393324 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0da7662b-e57b-44b8-8997-5b29c7a90102 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:47.397803 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-00c0880b-089d-481f-80c5-9a2de6dac3e3 service glance] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '77362a2134af4ede855882c58f40c472', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:47.398445 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0880b-089d-481f-80c5-9a2de6dac3e3 service glance] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:47.398717 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0880b-089d-481f-80c5-9a2de6dac3e3 service glance] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:47.398982 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-00c0880b-089d-481f-80c5-9a2de6dac3e3 service glance] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:47.412233 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0880b-089d-481f-80c5-9a2de6dac3e3 service glance] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:47.414340 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-00c0880b-089d-481f-80c5-9a2de6dac3e3 service glance] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:47.427699 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 791/1587] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:47 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 52 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:06:47.873728 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80325b-d03c-4e4d-9540-37eeb5162742 None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:47.874669 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80325b-d03c-4e4d-9540-37eeb5162742 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:47.874779 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6d80325b-d03c-4e4d-9540-37eeb5162742 None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:47.877662 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 797/1588] 10.222.0.49 () {54 vars in 912 bytes} [Sun Aug 21 01:06:47 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:06:47.885669 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7334d77-08ac-4a0c-85e4-b2fcca5e8d15 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:47.886118 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7334d77-08ac-4a0c-85e4-b2fcca5e8d15 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:47.886605 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b7334d77-08ac-4a0c-85e4-b2fcca5e8d15 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:47.943461 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-b7334d77-08ac-4a0c-85e4-b2fcca5e8d15 None None] MFA Rules not processed for user `78c29816db2d4193b293a0f94b4d1a01`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:47.945553 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b7334d77-08ac-4a0c-85e4-b2fcca5e8d15 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:48.014212 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 792/1589] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 21 01:06:47 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 130 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:48.027265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80325b-d03c-4e4d-9540-37eeb5162742 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:48.040415 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6d80325b-d03c-4e4d-9540-37eeb5162742 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:48.045114 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-323db164-988f-49b9-b181-2c4a916db26b service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:48.045763 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323db164-988f-49b9-b181-2c4a916db26b service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:48.046041 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323db164-988f-49b9-b181-2c4a916db26b service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:48.046310 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-323db164-988f-49b9-b181-2c4a916db26b service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:48.055247 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323db164-988f-49b9-b181-2c4a916db26b service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:48.056998 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-323db164-988f-49b9-b181-2c4a916db26b service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:48.067661 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 798/1590] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:48 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 41 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:06:48.616607 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1414e1e-f8d3-4d8a-b82b-ccdfc51ac99f None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:48.617522 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1414e1e-f8d3-4d8a-b82b-ccdfc51ac99f None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:48.617522 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f1414e1e-f8d3-4d8a-b82b-ccdfc51ac99f None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:48.619135 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 793/1591] 10.222.0.49 () {54 vars in 962 bytes} [Sun Aug 21 01:06:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:06:48.628600 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd08189-41bc-45a5-af3a-c9629fe4a7ba None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:48.629122 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd08189-41bc-45a5-af3a-c9629fe4a7ba None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:48.629613 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5dd08189-41bc-45a5-af3a-c9629fe4a7ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:48.635769 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a69685-6f21-454c-a656-75337570d6de None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:48.636136 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a69685-6f21-454c-a656-75337570d6de None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:48.636531 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-79a69685-6f21-454c-a656-75337570d6de None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:48.638174 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 794/1592] 10.222.0.49 () {54 vars in 961 bytes} [Sun Aug 21 01:06:48 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 01:06:48.650155 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10489252-f9b6-4f0c-9f33-9217bb1cdb57 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:48.650732 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10489252-f9b6-4f0c-9f33-9217bb1cdb57 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:48.651255 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-10489252-f9b6-4f0c-9f33-9217bb1cdb57 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:48.662852 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-5dd08189-41bc-45a5-af3a-c9629fe4a7ba None None] MFA Rules not processed for user `6b003ae4a082485ab608bf84c1657159`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:48.664835 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5dd08189-41bc-45a5-af3a-c9629fe4a7ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:48.681130 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 799/1593] 10.222.0.49 () {58 vars in 1059 bytes} [Sun Aug 21 01:06:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:48.683481 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-10489252-f9b6-4f0c-9f33-9217bb1cdb57 None None] MFA Rules not processed for user `3a225f81f16e4cf2a1e62bbb3ec8eee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:48.684818 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-10489252-f9b6-4f0c-9f33-9217bb1cdb57 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:48.688697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f572c-491c-4106-a026-8580daec99ee None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:48.689340 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f572c-491c-4106-a026-8580daec99ee None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:48.689968 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bb6f572c-491c-4106-a026-8580daec99ee None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:48.693293 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 800/1594] 10.222.0.49 () {54 vars in 912 bytes} [Sun Aug 21 01:06:48 2022] GET /identity => generated 270 bytes in 6 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 01:06:48.701117 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a1937-9e1b-414e-a5db-b14e04d1abd1 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:48.702366 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a1937-9e1b-414e-a5db-b14e04d1abd1 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:48.702366 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-984a1937-9e1b-414e-a5db-b14e04d1abd1 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:48.740153 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-984a1937-9e1b-414e-a5db-b14e04d1abd1 None None] MFA Rules not processed for user `6b003ae4a082485ab608bf84c1657159`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:48.742615 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-984a1937-9e1b-414e-a5db-b14e04d1abd1 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:48.759297 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 801/1595] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 21 01:06:48 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:06:48.779238 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a1937-9e1b-414e-a5db-b14e04d1abd1 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:48.794195 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-984a1937-9e1b-414e-a5db-b14e04d1abd1 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:48.800082 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-36ee8b97-fc55-48f1-9edb-59df00b46f28 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:48.801306 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee8b97-fc55-48f1-9edb-59df00b46f28 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:48.801801 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee8b97-fc55-48f1-9edb-59df00b46f28 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:48.802307 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-36ee8b97-fc55-48f1-9edb-59df00b46f28 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:48.808741 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 795/1596] 10.222.0.49 () {58 vars in 1058 bytes} [Sun Aug 21 01:06:48 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 160 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:06:48.818416 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee8b97-fc55-48f1-9edb-59df00b46f28 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:48.818700 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10489252-f9b6-4f0c-9f33-9217bb1cdb57 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:48.820365 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-36ee8b97-fc55-48f1-9edb-59df00b46f28 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:48.833432 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-10489252-f9b6-4f0c-9f33-9217bb1cdb57 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:48.834649 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 802/1597] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:48 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:06:48.841982 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21f418-7a57-4ec3-a79f-dd60abaf2761 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a225f81f16e4cf2a1e62bbb3ec8eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:48.843014 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21f418-7a57-4ec3-a79f-dd60abaf2761 service placement] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:48.843493 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21f418-7a57-4ec3-a79f-dd60abaf2761 service placement] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:48.843950 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6f21f418-7a57-4ec3-a79f-dd60abaf2761 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:48.847091 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-6f21f418-7a57-4ec3-a79f-dd60abaf2761 service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:48.868756 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21f418-7a57-4ec3-a79f-dd60abaf2761 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:48.871981 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-6f21f418-7a57-4ec3-a79f-dd60abaf2761 service placement] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:48.890432 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 796/1598] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:06:48 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:06:51.180985 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff42512-649a-4cc3-87e0-ad3dfdbbd128 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:51.181822 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff42512-649a-4cc3-87e0-ad3dfdbbd128 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:51.181822 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-6ff42512-649a-4cc3-87e0-ad3dfdbbd128 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:51.205184 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-6ff42512-649a-4cc3-87e0-ad3dfdbbd128 None None] MFA Rules not processed for user `a06f043017114f9090264293f5ede6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:06:51.206639 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-6ff42512-649a-4cc3-87e0-ad3dfdbbd128 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:06:51.216436 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 803/1599] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 21 01:06:51 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:06:51.242695 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21f418-7a57-4ec3-a79f-dd60abaf2761 service placement] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:06:51.264328 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-6f21f418-7a57-4ec3-a79f-dd60abaf2761 service placement] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:06:51.270103 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b5a71-47be-498e-99be-2678b3701bca service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66a877fdca340f48f54b48e5367a194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:06:51.270894 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b5a71-47be-498e-99be-2678b3701bca service swift] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:06:51.271190 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b5a71-47be-498e-99be-2678b3701bca service swift] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:06:51.271466 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7e3b5a71-47be-498e-99be-2678b3701bca service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:06:51.282784 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b5a71-47be-498e-99be-2678b3701bca service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:06:51.284706 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7e3b5a71-47be-498e-99be-2678b3701bca service swift] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:06:51.309998 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 797/1600] 10.222.0.49 () {60 vars in 1384 bytes} [Sun Aug 21 01:06:51 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:07:01.198960 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=64 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:01.292888 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=76 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:06.649904 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7885c18-1780-42b3-bb98-3b6d110a85c8 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:06.654383 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7885c18-1780-42b3-bb98-3b6d110a85c8 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:06.654383 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-f7885c18-1780-42b3-bb98-3b6d110a85c8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:06.679927 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-f7885c18-1780-42b3-bb98-3b6d110a85c8 None None] MFA Rules not processed for user `78c29816db2d4193b293a0f94b4d1a01`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:06.682205 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-f7885c18-1780-42b3-bb98-3b6d110a85c8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:06.692504 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 804/1601] 10.222.0.52 () {58 vars in 1015 bytes} [Sun Aug 21 01:07:06 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 44 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:07:06.734711 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b5a71-47be-498e-99be-2678b3701bca service swift] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:06.747615 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7e3b5a71-47be-498e-99be-2678b3701bca service swift] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:06.752296 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8b885eea-112e-460f-b6fc-71b4e4449ea9 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:06.753129 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b885eea-112e-460f-b6fc-71b4e4449ea9 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:06.753445 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b885eea-112e-460f-b6fc-71b4e4449ea9 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:06.753774 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8b885eea-112e-460f-b6fc-71b4e4449ea9 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:06.766461 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b885eea-112e-460f-b6fc-71b4e4449ea9 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:06.768082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8b885eea-112e-460f-b6fc-71b4e4449ea9 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:06.781934 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 798/1602] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:06 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 48 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:07.634018 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533a894-4a30-4023-827d-7f18298d959f None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:07.634659 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533a894-4a30-4023-827d-7f18298d959f None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:07.635226 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b533a894-4a30-4023-827d-7f18298d959f None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:07.638198 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 805/1603] 10.222.0.49 () {54 vars in 921 bytes} [Sun Aug 21 01:07:07 2022] GET /identity => generated 270 bytes in 8 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:07:07.660264 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71451c48-ac3e-42ed-a033-fe5d54ba16ac None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:07.660879 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71451c48-ac3e-42ed-a033-fe5d54ba16ac None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:07.661625 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-71451c48-ac3e-42ed-a033-fe5d54ba16ac None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:07.684737 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-71451c48-ac3e-42ed-a033-fe5d54ba16ac None None] MFA Rules not processed for user `6b003ae4a082485ab608bf84c1657159`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:07.686103 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-71451c48-ac3e-42ed-a033-fe5d54ba16ac None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:07.699325 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 799/1604] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 21 01:07:07 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 41 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:07.728864 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533a894-4a30-4023-827d-7f18298d959f None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:07.751747 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b533a894-4a30-4023-827d-7f18298d959f None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:07.759865 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-abd31ec1-c9b8-4f6d-be57-7aa60a470e87 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:07.760527 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd31ec1-c9b8-4f6d-be57-7aa60a470e87 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:07.760803 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd31ec1-c9b8-4f6d-be57-7aa60a470e87 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:07.761141 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-abd31ec1-c9b8-4f6d-be57-7aa60a470e87 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:07.771709 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd31ec1-c9b8-4f6d-be57-7aa60a470e87 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:07.773436 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-abd31ec1-c9b8-4f6d-be57-7aa60a470e87 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:07.784748 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 806/1605] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:07 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 56 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:14.767643 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54049f3-0e4b-47b8-bf29-a847cdc5da52 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:14.768403 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54049f3-0e4b-47b8-bf29-a847cdc5da52 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:14.768403 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b54049f3-0e4b-47b8-bf29-a847cdc5da52 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:14.770012 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 800/1606] 10.222.0.49 () {54 vars in 921 bytes} [Sun Aug 21 01:07:14 2022] GET /identity => generated 270 bytes in 3 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:07:14.777421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e123b36-faa6-4239-9c6f-70886669b5ef None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:14.778026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e123b36-faa6-4239-9c6f-70886669b5ef None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:14.778026 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5e123b36-faa6-4239-9c6f-70886669b5ef None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:14.801919 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-5e123b36-faa6-4239-9c6f-70886669b5ef None None] MFA Rules not processed for user `6b003ae4a082485ab608bf84c1657159`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:14.803166 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-5e123b36-faa6-4239-9c6f-70886669b5ef None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:14.813726 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 807/1607] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 21 01:07:14 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 37 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:14.828414 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54049f3-0e4b-47b8-bf29-a847cdc5da52 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:14.845390 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b54049f3-0e4b-47b8-bf29-a847cdc5da52 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:14.852805 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d09da28f-7800-45ac-af3f-13dbcab239e8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:14.853412 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09da28f-7800-45ac-af3f-13dbcab239e8 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:14.853696 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09da28f-7800-45ac-af3f-13dbcab239e8 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:14.853967 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d09da28f-7800-45ac-af3f-13dbcab239e8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:14.865825 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09da28f-7800-45ac-af3f-13dbcab239e8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:14.867478 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d09da28f-7800-45ac-af3f-13dbcab239e8 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:14.880178 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 801/1608] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:14 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 53 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:24.795911 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=12 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:24.874804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=15 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:30.491720 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff9f1d-f87e-4e94-9361-430cf50d2d77 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:30.492236 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff9f1d-f87e-4e94-9361-430cf50d2d77 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:30.492236 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-24ff9f1d-f87e-4e94-9361-430cf50d2d77 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:30.513176 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-24ff9f1d-f87e-4e94-9361-430cf50d2d77 None None] MFA Rules not processed for user `41864937ad9d47688b054e39744cd180`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:30.514415 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-24ff9f1d-f87e-4e94-9361-430cf50d2d77 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:30.522669 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 808/1609] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 21 01:07:30 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 32 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:30.874501 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c03fb-db33-4993-8f8e-af090ddbddd6 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:30.875085 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c03fb-db33-4993-8f8e-af090ddbddd6 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:30.875085 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-243c03fb-db33-4993-8f8e-af090ddbddd6 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:30.895693 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-243c03fb-db33-4993-8f8e-af090ddbddd6 None None] MFA Rules not processed for user `78c29816db2d4193b293a0f94b4d1a01`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:30.896939 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-243c03fb-db33-4993-8f8e-af090ddbddd6 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:30.903937 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 802/1610] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 21 01:07:30 2022] POST /identity/v3/auth/tokens => generated 3121 bytes in 31 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:30.918030 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff9f1d-f87e-4e94-9361-430cf50d2d77 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:30.931186 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-24ff9f1d-f87e-4e94-9361-430cf50d2d77 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:30.935687 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-c9b6239a-b90f-470d-9533-1405ee403ac0 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:30.936302 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6239a-b90f-470d-9533-1405ee403ac0 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:30.937579 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6239a-b90f-470d-9533-1405ee403ac0 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:30.937579 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-c9b6239a-b90f-470d-9533-1405ee403ac0 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:30.945499 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6239a-b90f-470d-9533-1405ee403ac0 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:30.946955 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-c9b6239a-b90f-470d-9533-1405ee403ac0 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:30.955967 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 809/1611] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:30 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:38.680338 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c03fb-db33-4993-8f8e-af090ddbddd6 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:38.692048 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-243c03fb-db33-4993-8f8e-af090ddbddd6 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:38.697758 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9199b1a0-4b96-4779-96a6-39303038853f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:38.698626 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199b1a0-4b96-4779-96a6-39303038853f service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:38.699034 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199b1a0-4b96-4779-96a6-39303038853f service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:38.699729 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9199b1a0-4b96-4779-96a6-39303038853f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:38.714129 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199b1a0-4b96-4779-96a6-39303038853f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:38.715606 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9199b1a0-4b96-4779-96a6-39303038853f service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:38.726883 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 803/1612] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:38 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:07:40.951939 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=9 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:41.165956 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba73a91-1e00-4a6b-9400-6b150c7124ff None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:41.166353 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba73a91-1e00-4a6b-9400-6b150c7124ff None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:41.166653 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-aba73a91-1e00-4a6b-9400-6b150c7124ff None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:41.168617 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 810/1613] 10.222.0.49 () {54 vars in 921 bytes} [Sun Aug 21 01:07:41 2022] GET /identity => generated 270 bytes in 5 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:07:41.175846 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b04a8-0953-41e2-ad71-191d0b1c45ba None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:41.177250 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b04a8-0953-41e2-ad71-191d0b1c45ba None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:41.177686 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-df8b04a8-0953-41e2-ad71-191d0b1c45ba None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:41.208302 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-df8b04a8-0953-41e2-ad71-191d0b1c45ba None None] MFA Rules not processed for user `6b003ae4a082485ab608bf84c1657159`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:07:41.210298 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-df8b04a8-0953-41e2-ad71-191d0b1c45ba None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:07:41.222728 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 804/1614] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 21 01:07:41 2022] POST /identity/v3/auth/tokens => generated 3372 bytes in 49 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:07:41.250895 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba73a91-1e00-4a6b-9400-6b150c7124ff None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:07:41.270158 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-aba73a91-1e00-4a6b-9400-6b150c7124ff None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:07:41.281628 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ff4b29fe-38b0-4d4c-aaee-4c61a4d3d47d service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:07:41.282964 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b29fe-38b0-4d4c-aaee-4c61a4d3d47d service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:07:41.283996 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b29fe-38b0-4d4c-aaee-4c61a4d3d47d service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:07:41.284785 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ff4b29fe-38b0-4d4c-aaee-4c61a4d3d47d service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:07:41.302595 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b29fe-38b0-4d4c-aaee-4c61a4d3d47d service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:07:41.305109 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ff4b29fe-38b0-4d4c-aaee-4c61a4d3d47d service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:07:41.322598 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 811/1615] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:07:41 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:07:51.202483 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=12 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:07:51.315862 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=6 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:31.007732 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf75983-083f-489c-b584-37bb625e2005 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:31.008354 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf75983-083f-489c-b584-37bb625e2005 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:31.008354 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bbf75983-083f-489c-b584-37bb625e2005 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:31.028341 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-bbf75983-083f-489c-b584-37bb625e2005 None None] MFA Rules not processed for user `41864937ad9d47688b054e39744cd180`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:31.029582 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-bbf75983-083f-489c-b584-37bb625e2005 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:31.036949 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 805/1616] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 21 01:08:31 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 30 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:41.022557 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:08:49.119554 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52263b7-ccae-4db8-b2f7-4687c5a1f5e0 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:49.120245 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52263b7-ccae-4db8-b2f7-4687c5a1f5e0 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:49.120245 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a52263b7-ccae-4db8-b2f7-4687c5a1f5e0 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:49.145694 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-a52263b7-ccae-4db8-b2f7-4687c5a1f5e0 None None] MFA Rules not processed for user `a06f043017114f9090264293f5ede6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:49.147712 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-a52263b7-ccae-4db8-b2f7-4687c5a1f5e0 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:49.159915 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 812/1617] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 21 01:08:49 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:49.224862 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf75983-083f-489c-b584-37bb625e2005 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:08:49.240802 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bbf75983-083f-489c-b584-37bb625e2005 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:08:49.247721 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-5ad791da-a98e-4e5d-92d4-a8fb371eb0fc service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66a877fdca340f48f54b48e5367a194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:08:49.248464 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad791da-a98e-4e5d-92d4-a8fb371eb0fc service swift] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:49.248780 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad791da-a98e-4e5d-92d4-a8fb371eb0fc service swift] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:49.249126 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-5ad791da-a98e-4e5d-92d4-a8fb371eb0fc service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:49.259104 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad791da-a98e-4e5d-92d4-a8fb371eb0fc service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:08:49.260856 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-5ad791da-a98e-4e5d-92d4-a8fb371eb0fc service swift] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:08:49.270842 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 806/1618] 10.222.0.49 () {60 vars in 1384 bytes} [Sun Aug 21 01:08:49 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:08:54.774645 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70774141-c359-4ab9-b50f-6157cfcf706c None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:08:54.775457 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70774141-c359-4ab9-b50f-6157cfcf706c None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:08:54.775663 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-70774141-c359-4ab9-b50f-6157cfcf706c None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:08:54.800011 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-70774141-c359-4ab9-b50f-6157cfcf706c None None] MFA Rules not processed for user `41864937ad9d47688b054e39744cd180`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:08:54.802227 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-70774141-c359-4ab9-b50f-6157cfcf706c None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:08:54.814085 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 813/1619] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 21 01:08:54 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 42 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:08:59.266888 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=6 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:04.792087 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=6 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:31.912261 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d5255-c8c9-40ea-af10-7ffa957afdbe None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:31.913278 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d5255-c8c9-40ea-af10-7ffa957afdbe None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:31.913278 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b96d5255-c8c9-40ea-af10-7ffa957afdbe None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:31.945904 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-b96d5255-c8c9-40ea-af10-7ffa957afdbe None None] MFA Rules not processed for user `a06f043017114f9090264293f5ede6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:09:31.948567 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-b96d5255-c8c9-40ea-af10-7ffa957afdbe None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:09:31.964075 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 807/1620] 10.222.0.49 () {58 vars in 967 bytes} [Sun Aug 21 01:09:31 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 54 msecs (HTTP/1.1 201) 6 headers in 385 bytes (2 switches on core 0) Aug 21 01:09:31.991071 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70774141-c359-4ab9-b50f-6157cfcf706c None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:09:32.012839 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-70774141-c359-4ab9-b50f-6157cfcf706c None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:09:32.022133 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86888718-5cd4-4f35-bc0a-5e3f90a9446b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66a877fdca340f48f54b48e5367a194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:09:32.023165 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86888718-5cd4-4f35-bc0a-5e3f90a9446b service swift] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:09:32.023643 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86888718-5cd4-4f35-bc0a-5e3f90a9446b service swift] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:09:32.024115 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-86888718-5cd4-4f35-bc0a-5e3f90a9446b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:09:32.040829 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86888718-5cd4-4f35-bc0a-5e3f90a9446b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:09:32.043416 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-86888718-5cd4-4f35-bc0a-5e3f90a9446b service swift] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:09:32.058010 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 814/1621] 10.222.0.49 () {60 vars in 1384 bytes} [Sun Aug 21 01:09:31 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 68 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:09:41.937165 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:09:42.051505 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=6 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:00.634547 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66278d-f982-427b-ba57-2e32c33b3f96 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:00.635351 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66278d-f982-427b-ba57-2e32c33b3f96 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:00.635529 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fc66278d-f982-427b-ba57-2e32c33b3f96 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:00.657011 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-fc66278d-f982-427b-ba57-2e32c33b3f96 None None] MFA Rules not processed for user `41864937ad9d47688b054e39744cd180`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:10:00.658306 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-fc66278d-f982-427b-ba57-2e32c33b3f96 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:10:00.666108 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 808/1622] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 21 01:10:00 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 33 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:10:02.287616 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86888718-5cd4-4f35-bc0a-5e3f90a9446b service swift] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:02.301248 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-86888718-5cd4-4f35-bc0a-5e3f90a9446b service swift] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:02.307478 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d83848-f180-449c-b3f5-08029c523465 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a225f81f16e4cf2a1e62bbb3ec8eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:02.308179 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d83848-f180-449c-b3f5-08029c523465 service placement] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:02.308458 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d83848-f180-449c-b3f5-08029c523465 service placement] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:02.308736 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-42d83848-f180-449c-b3f5-08029c523465 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:02.318960 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d83848-f180-449c-b3f5-08029c523465 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:02.320627 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-42d83848-f180-449c-b3f5-08029c523465 service placement] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:02.332731 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 815/1623] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:02 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 46 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:10.650703 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=3 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:12.327636 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=6 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:10:19.352089 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66278d-f982-427b-ba57-2e32c33b3f96 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:10:19.362439 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fc66278d-f982-427b-ba57-2e32c33b3f96 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:10:19.366629 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1485253-922e-41d1-8bd2-b242b959f930 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:10:19.367263 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1485253-922e-41d1-8bd2-b242b959f930 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:10:19.367706 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1485253-922e-41d1-8bd2-b242b959f930 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:10:19.367980 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e1485253-922e-41d1-8bd2-b242b959f930 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:10:19.378270 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1485253-922e-41d1-8bd2-b242b959f930 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:10:19.379788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e1485253-922e-41d1-8bd2-b242b959f930 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:10:19.390962 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 809/1624] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:10:19 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 39 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:10:29.385881 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=6 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:11:56.773888 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d83848-f180-449c-b3f5-08029c523465 service placement] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:56.787604 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-42d83848-f180-449c-b3f5-08029c523465 service placement] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:56.794826 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde31b4-84c5-4093-818f-eb105ac7ee46 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:56.795605 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde31b4-84c5-4093-818f-eb105ac7ee46 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:56.795882 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde31b4-84c5-4093-818f-eb105ac7ee46 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:56.796145 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bde31b4-84c5-4093-818f-eb105ac7ee46 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:56.806855 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde31b4-84c5-4093-818f-eb105ac7ee46 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:56.808799 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8bde31b4-84c5-4093-818f-eb105ac7ee46 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:56.819942 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 816/1625] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:56 2022] GET /identity/v3/auth/tokens => generated 3260 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:56.915188 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1485253-922e-41d1-8bd2-b242b959f930 service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:56.930113 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e1485253-922e-41d1-8bd2-b242b959f930 service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:56.935518 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-687c5afc-3b9e-40fe-b9b5-047bb3632b37 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:56.936549 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c5afc-3b9e-40fe-b9b5-047bb3632b37 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:56.937025 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c5afc-3b9e-40fe-b9b5-047bb3632b37 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:56.937556 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-687c5afc-3b9e-40fe-b9b5-047bb3632b37 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:56.955775 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c5afc-3b9e-40fe-b9b5-047bb3632b37 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:56.957365 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-687c5afc-3b9e-40fe-b9b5-047bb3632b37 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:56.970709 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 810/1626] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:56 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 57 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:11:59.290859 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde31b4-84c5-4093-818f-eb105ac7ee46 service nova] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:11:59.394603 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bde31b4-84c5-4093-818f-eb105ac7ee46 service nova] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:11:59.399385 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57dab09-d8b6-48be-bfc4-9f29d733cf52 service cinder] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '67305d6f08d64f8ba39abe10bd4974c9', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:11:59.400077 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57dab09-d8b6-48be-bfc4-9f29d733cf52 service cinder] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:11:59.400409 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57dab09-d8b6-48be-bfc4-9f29d733cf52 service cinder] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:11:59.400886 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-b57dab09-d8b6-48be-bfc4-9f29d733cf52 service cinder] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:11:59.412844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57dab09-d8b6-48be-bfc4-9f29d733cf52 service cinder] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:11:59.414651 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-b57dab09-d8b6-48be-bfc4-9f29d733cf52 service cinder] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:11:59.429630 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 817/1627] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:11:59 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 141 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:12:06.449658 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437e61b-81e0-40d6-88c4-13ae5e48b615 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:06.450427 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437e61b-81e0-40d6-88c4-13ae5e48b615 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:06.450616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e437e61b-81e0-40d6-88c4-13ae5e48b615 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:06.486836 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-e437e61b-81e0-40d6-88c4-13ae5e48b615 None None] MFA Rules not processed for user `a06f043017114f9090264293f5ede6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:06.489008 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e437e61b-81e0-40d6-88c4-13ae5e48b615 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:06.502782 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 811/1628] 10.222.0.49 () {58 vars in 967 bytes} [Sun Aug 21 01:12:06 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:06.576399 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57dab09-d8b6-48be-bfc4-9f29d733cf52 service cinder] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:06.600477 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-b57dab09-d8b6-48be-bfc4-9f29d733cf52 service cinder] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:06.608903 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b72183-5c7f-4efc-9bc1-0521d2aae50b service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66a877fdca340f48f54b48e5367a194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:06.609880 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b72183-5c7f-4efc-9bc1-0521d2aae50b service swift] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:06.610316 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b72183-5c7f-4efc-9bc1-0521d2aae50b service swift] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:06.610765 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-01b72183-5c7f-4efc-9bc1-0521d2aae50b service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:06.626789 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b72183-5c7f-4efc-9bc1-0521d2aae50b service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:06.629814 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-01b72183-5c7f-4efc-9bc1-0521d2aae50b service swift] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:06.646085 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 818/1629] 10.222.0.49 () {60 vars in 1384 bytes} [Sun Aug 21 01:12:06 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 71 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:12:07.390087 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e181702-d6ff-4854-9046-019d7a001e22 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:07.390500 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e181702-d6ff-4854-9046-019d7a001e22 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:07.390860 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1e181702-d6ff-4854-9046-019d7a001e22 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:07.414793 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-1e181702-d6ff-4854-9046-019d7a001e22 None None] MFA Rules not processed for user `a06f043017114f9090264293f5ede6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:07.415973 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-1e181702-d6ff-4854-9046-019d7a001e22 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:07.423904 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 812/1630] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 21 01:12:07 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:07.436914 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b72183-5c7f-4efc-9bc1-0521d2aae50b service swift] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:07.451069 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-01b72183-5c7f-4efc-9bc1-0521d2aae50b service swift] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:07.459575 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a6033-9d48-45b5-9262-7f41588a3352 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66a877fdca340f48f54b48e5367a194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:07.460504 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a6033-9d48-45b5-9262-7f41588a3352 service swift] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:07.460952 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a6033-9d48-45b5-9262-7f41588a3352 service swift] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:07.461420 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-409a6033-9d48-45b5-9262-7f41588a3352 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:07.476722 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a6033-9d48-45b5-9262-7f41588a3352 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:07.479588 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-409a6033-9d48-45b5-9262-7f41588a3352 service swift] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:07.495609 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 819/1631] 10.222.0.49 () {60 vars in 1384 bytes} [Sun Aug 21 01:12:07 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 59 msecs (HTTP/1.1 200) 6 headers in 379 bytes (2 switches on core 0) Aug 21 01:12:17.339881 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfe7ce-3671-4827-8664-37c98763b943 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:17.340630 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfe7ce-3671-4827-8664-37c98763b943 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:17.340630 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-bedfe7ce-3671-4827-8664-37c98763b943 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:17.364476 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-bedfe7ce-3671-4827-8664-37c98763b943 None None] MFA Rules not processed for user `f599b0676c2241b88e7192223f5cee5b`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:17.365675 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-bedfe7ce-3671-4827-8664-37c98763b943 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:17.374033 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 813/1632] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 21 01:12:17 2022] POST /identity/v3/auth/tokens => generated 3260 bytes in 35 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:17.488971 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=44 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:17.717983 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a6033-9d48-45b5-9262-7f41588a3352 service swift] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:17.729797 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-409a6033-9d48-45b5-9262-7f41588a3352 service swift] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:17.734502 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2e35b1dc-698c-41b5-80fb-73f84994f7da service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:17.735133 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35b1dc-698c-41b5-80fb-73f84994f7da service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:17.735444 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35b1dc-698c-41b5-80fb-73f84994f7da service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:17.735711 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2e35b1dc-698c-41b5-80fb-73f84994f7da service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:17.745159 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35b1dc-698c-41b5-80fb-73f84994f7da service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:17.746703 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2e35b1dc-698c-41b5-80fb-73f84994f7da service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:17.756552 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 820/1633] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:12:17 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 40 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:12:18.164848 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfe7ce-3671-4827-8664-37c98763b943 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:18.178906 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-bedfe7ce-3671-4827-8664-37c98763b943 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:18.184831 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e595ef-bf04-470d-8e61-2279e23933e4 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a225f81f16e4cf2a1e62bbb3ec8eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:18.185519 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e595ef-bf04-470d-8e61-2279e23933e4 service placement] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:18.185804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e595ef-bf04-470d-8e61-2279e23933e4 service placement] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:18.186082 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d7e595ef-bf04-470d-8e61-2279e23933e4 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:18.195961 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e595ef-bf04-470d-8e61-2279e23933e4 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:18.197637 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d7e595ef-bf04-470d-8e61-2279e23933e4 service placement] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:18.209874 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 814/1634] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:12:18 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:12:19.745386 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddeb77-ea29-4837-8352-202038d3b4aa None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:19.746195 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddeb77-ea29-4837-8352-202038d3b4aa None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:19.746344 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e0ddeb77-ea29-4837-8352-202038d3b4aa None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:19.780935 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-e0ddeb77-ea29-4837-8352-202038d3b4aa None None] MFA Rules not processed for user `a06f043017114f9090264293f5ede6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:19.783049 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-e0ddeb77-ea29-4837-8352-202038d3b4aa None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:19.796265 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 821/1635] 10.222.0.49 () {58 vars in 1009 bytes} [Sun Aug 21 01:12:19 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 53 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:19.817325 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e595ef-bf04-470d-8e61-2279e23933e4 service placement] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:19.824275 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=22 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:19.831842 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d7e595ef-bf04-470d-8e61-2279e23933e4 service placement] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:19.838836 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0a28c-0285-4543-9955-4453e50c4f05 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66a877fdca340f48f54b48e5367a194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:19.840347 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0a28c-0285-4543-9955-4453e50c4f05 service swift] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:19.840989 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0a28c-0285-4543-9955-4453e50c4f05 service swift] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:19.841576 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-2df0a28c-0285-4543-9955-4453e50c4f05 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:19.857673 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0a28c-0285-4543-9955-4453e50c4f05 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:19.860663 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-2df0a28c-0285-4543-9955-4453e50c4f05 service swift] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:19.876788 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 815/1636] 10.222.0.49 () {60 vars in 1384 bytes} [Sun Aug 21 01:12:19 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:12:20.740499 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddeb77-ea29-4837-8352-202038d3b4aa None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:20.757263 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e0ddeb77-ea29-4837-8352-202038d3b4aa None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:20.763437 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce755d8-4c16-414a-8e83-27b2bb5c5aec service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:20.764562 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce755d8-4c16-414a-8e83-27b2bb5c5aec service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:20.765093 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce755d8-4c16-414a-8e83-27b2bb5c5aec service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:20.765482 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-dce755d8-4c16-414a-8e83-27b2bb5c5aec service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:20.776346 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce755d8-4c16-414a-8e83-27b2bb5c5aec service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:20.777920 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-dce755d8-4c16-414a-8e83-27b2bb5c5aec service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:20.799247 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 822/1637] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:12:20 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:12:21.784126 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0a28c-0285-4543-9955-4453e50c4f05 service swift] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:21.808574 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-2df0a28c-0285-4543-9955-4453e50c4f05 service swift] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:21.827175 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ac0fa-83ed-4a3a-9d6c-2fadc08b3391 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:21.828185 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ac0fa-83ed-4a3a-9d6c-2fadc08b3391 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:21.828487 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ac0fa-83ed-4a3a-9d6c-2fadc08b3391 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:21.829849 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-895ac0fa-83ed-4a3a-9d6c-2fadc08b3391 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:21.842974 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ac0fa-83ed-4a3a-9d6c-2fadc08b3391 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:21.847297 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-895ac0fa-83ed-4a3a-9d6c-2fadc08b3391 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:21.886565 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 816/1638] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:12:21 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 104 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:12:30.783874 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=15 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:31.861699 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=11 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:36.129810 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce755d8-4c16-414a-8e83-27b2bb5c5aec service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:36.146342 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-dce755d8-4c16-414a-8e83-27b2bb5c5aec service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:36.152593 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-846fe98d-3e41-45c7-993a-864da5386a49 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:36.153258 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fe98d-3e41-45c7-993a-864da5386a49 service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:36.153534 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fe98d-3e41-45c7-993a-864da5386a49 service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:36.153802 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-846fe98d-3e41-45c7-993a-864da5386a49 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:36.163157 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846fe98d-3e41-45c7-993a-864da5386a49 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:36.164885 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-846fe98d-3e41-45c7-993a-864da5386a49 service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:36.175705 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 823/1639] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:12:36 2022] GET /identity/v3/auth/tokens => generated 3252 bytes in 47 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:12:38.440550 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ac0fa-83ed-4a3a-9d6c-2fadc08b3391 service nova] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:38.460226 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-895ac0fa-83ed-4a3a-9d6c-2fadc08b3391 service nova] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:38.469829 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2837287-52c1-4cf2-875f-2e471392648b service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:38.471118 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2837287-52c1-4cf2-875f-2e471392648b service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:38.471996 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2837287-52c1-4cf2-875f-2e471392648b service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:38.472549 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-d2837287-52c1-4cf2-875f-2e471392648b service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:38.492167 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2837287-52c1-4cf2-875f-2e471392648b service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:38.495435 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-d2837287-52c1-4cf2-875f-2e471392648b service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:38.519143 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 817/1640] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:12:38 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 79 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:12:42.566782 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2d42a-be8f-4f63-8544-df34ebf70846 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:42.567383 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2d42a-be8f-4f63-8544-df34ebf70846 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:42.567546 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-21f2d42a-be8f-4f63-8544-df34ebf70846 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:42.607715 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-21f2d42a-be8f-4f63-8544-df34ebf70846 None None] MFA Rules not processed for user `41864937ad9d47688b054e39744cd180`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:12:42.610431 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-21f2d42a-be8f-4f63-8544-df34ebf70846 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:12:42.626318 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 824/1641] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 21 01:12:42 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 62 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:12:48.511052 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=6 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:52.599719 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=9 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:12:53.124293 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2837287-52c1-4cf2-875f-2e471392648b service nova] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:53.141778 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-d2837287-52c1-4cf2-875f-2e471392648b service nova] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:53.147837 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-001b95b2-f995-4213-9ab2-55001b854f36 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:53.148534 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b95b2-f995-4213-9ab2-55001b854f36 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:53.148854 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b95b2-f995-4213-9ab2-55001b854f36 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:53.149230 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-001b95b2-f995-4213-9ab2-55001b854f36 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:53.161415 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b95b2-f995-4213-9ab2-55001b854f36 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:53.163029 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-001b95b2-f995-4213-9ab2-55001b854f36 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:53.177766 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 818/1642] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:12:53 2022] GET /identity/v3/auth/tokens => generated 3325 bytes in 55 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:12:55.496777 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2d42a-be8f-4f63-8544-df34ebf70846 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:12:55.520870 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-21f2d42a-be8f-4f63-8544-df34ebf70846 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:12:55.532349 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830092d8-3ad4-4015-976b-1f22380b3aff service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:12:55.533432 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830092d8-3ad4-4015-976b-1f22380b3aff service nova] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:12:55.534212 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830092d8-3ad4-4015-976b-1f22380b3aff service nova] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:12:55.534696 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-830092d8-3ad4-4015-976b-1f22380b3aff service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:12:55.548500 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830092d8-3ad4-4015-976b-1f22380b3aff service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:12:55.550743 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-830092d8-3ad4-4015-976b-1f22380b3aff service nova] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:12:55.568337 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 825/1643] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:12:55 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 72 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:13:03.169538 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=6 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:13:05.560842 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=6 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:08.287956 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4de8b-e65e-4fbe-adf8-d248e8f49bf8 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:08.288889 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4de8b-e65e-4fbe-adf8-d248e8f49bf8 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:08.288889 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8bc4de8b-e65e-4fbe-adf8-d248e8f49bf8 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:08.322804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-8bc4de8b-e65e-4fbe-adf8-d248e8f49bf8 None None] MFA Rules not processed for user `41864937ad9d47688b054e39744cd180`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:08.324405 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-8bc4de8b-e65e-4fbe-adf8-d248e8f49bf8 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:08.356545 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 819/1644] 10.222.0.49 () {58 vars in 958 bytes} [Sun Aug 21 01:15:08 2022] POST /identity/v3/auth/tokens => generated 3252 bytes in 70 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:08.868200 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830092d8-3ad4-4015-976b-1f22380b3aff service nova] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:08.870186 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-830092d8-3ad4-4015-976b-1f22380b3aff service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:08.957491 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-830092d8-3ad4-4015-976b-1f22380b3aff service nova] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:08.962232 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e72f6629-3b4f-4ba6-92a4-136da503343f service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:08.963024 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f6629-3b4f-4ba6-92a4-136da503343f service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:08.963425 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f6629-3b4f-4ba6-92a4-136da503343f service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:08.963789 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e72f6629-3b4f-4ba6-92a4-136da503343f service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:08.972860 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f6629-3b4f-4ba6-92a4-136da503343f service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:08.974427 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e72f6629-3b4f-4ba6-92a4-136da503343f service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:08.984820 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 826/1645] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:08 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 117 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:15:10.439263 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4de8b-e65e-4fbe-adf8-d248e8f49bf8 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:10.503051 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8bc4de8b-e65e-4fbe-adf8-d248e8f49bf8 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:10.511576 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406e652-26c1-4bed-8f41-d3a934ede1ee service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a225f81f16e4cf2a1e62bbb3ec8eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:10.512607 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406e652-26c1-4bed-8f41-d3a934ede1ee service placement] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:10.513029 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406e652-26c1-4bed-8f41-d3a934ede1ee service placement] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:10.513470 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-9406e652-26c1-4bed-8f41-d3a934ede1ee service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:10.516634 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-9406e652-26c1-4bed-8f41-d3a934ede1ee service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:10.573460 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406e652-26c1-4bed-8f41-d3a934ede1ee service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:10.576616 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-9406e652-26c1-4bed-8f41-d3a934ede1ee service placement] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:10.597074 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 820/1646] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:10 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 159 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:15:18.979895 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=24 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:20.588944 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=33 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:24.623562 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9330c-6260-4f98-a688-7dc349b91880 None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:24.624198 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9330c-6260-4f98-a688-7dc349b91880 None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:24.624554 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-95f9330c-6260-4f98-a688-7dc349b91880 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:24.676245 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-95f9330c-6260-4f98-a688-7dc349b91880 None None] MFA Rules not processed for user `a06f043017114f9090264293f5ede6c4`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:24.677809 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-95f9330c-6260-4f98-a688-7dc349b91880 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:24.703150 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 827/1647] 10.222.0.49 () {58 vars in 967 bytes} [Sun Aug 21 01:15:24 2022] POST /identity/v3/auth/tokens => generated 3195 bytes in 82 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:24.762187 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406e652-26c1-4bed-8f41-d3a934ede1ee service placement] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:24.774577 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-9406e652-26c1-4bed-8f41-d3a934ede1ee service placement] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:24.780963 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d72b3-fc65-40a6-86b6-553efba8e7b1 service swift] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'f66a877fdca340f48f54b48e5367a194', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:24.781649 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d72b3-fc65-40a6-86b6-553efba8e7b1 service swift] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:24.781934 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d72b3-fc65-40a6-86b6-553efba8e7b1 service swift] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:24.782341 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-e49d72b3-fc65-40a6-86b6-553efba8e7b1 service swift] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:24.792574 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d72b3-fc65-40a6-86b6-553efba8e7b1 service swift] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:24.794673 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-e49d72b3-fc65-40a6-86b6-553efba8e7b1 service swift] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:24.804647 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 821/1648] 10.222.0.49 () {60 vars in 1384 bytes} [Sun Aug 21 01:15:24 2022] GET /identity/v3/auth/tokens?nocatalog => generated 604 bytes in 43 msecs (HTTP/1.1 200) 6 headers in 379 bytes (1 switches on core 0) Aug 21 01:15:25.289089 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9330c-6260-4f98-a688-7dc349b91880 None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:25.300029 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-95f9330c-6260-4f98-a688-7dc349b91880 None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:25.303944 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-8e20decb-825c-4152-887f-0050503d9104 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:25.305177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20decb-825c-4152-887f-0050503d9104 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:25.305177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20decb-825c-4152-887f-0050503d9104 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:25.305177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-8e20decb-825c-4152-887f-0050503d9104 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:25.433891 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e20decb-825c-4152-887f-0050503d9104 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:25.435749 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-8e20decb-825c-4152-887f-0050503d9104 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:25.459370 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 828/1649] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:25 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 171 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:30.687867 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d72b3-fc65-40a6-86b6-553efba8e7b1 service swift] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:30.690646 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-e49d72b3-fc65-40a6-86b6-553efba8e7b1 service swift] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:30.710152 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-e49d72b3-fc65-40a6-86b6-553efba8e7b1 service swift] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:30.717118 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-1a17fa65-62bd-4b63-997e-d25af7d1a888 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:30.718263 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17fa65-62bd-4b63-997e-d25af7d1a888 service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:30.718747 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17fa65-62bd-4b63-997e-d25af7d1a888 service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:30.719177 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-1a17fa65-62bd-4b63-997e-d25af7d1a888 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:30.733523 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17fa65-62bd-4b63-997e-d25af7d1a888 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:30.736250 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-1a17fa65-62bd-4b63-997e-d25af7d1a888 service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:30.755804 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 822/1650] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:30 2022] GET /identity/v3/auth/tokens => generated 3323 bytes in 69 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:30.995501 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887147f-e30e-4f7a-8bd8-fe00a06c69df None None] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:30.996417 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887147f-e30e-4f7a-8bd8-fe00a06c69df None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:30.996838 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-0887147f-e30e-4f7a-8bd8-fe00a06c69df None None] PATH_INFO: `/` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:31.000222 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 829/1651] 10.222.0.49 () {54 vars in 921 bytes} [Sun Aug 21 01:15:30 2022] GET /identity => generated 270 bytes in 7 msecs (HTTP/1.1 300) 6 headers in 234 bytes (1 switches on core 0) Aug 21 01:15:31.013748 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0ad46-6af8-4d38-8bdd-1de2608bcca4 None None] REQUEST_METHOD: `POST` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:31.014595 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0ad46-6af8-4d38-8bdd-1de2608bcca4 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:31.015238 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eda0ad46-6af8-4d38-8bdd-1de2608bcca4 None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:31.118237 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.auth.core [None req-eda0ad46-6af8-4d38-8bdd-1de2608bcca4 None None] MFA Rules not processed for user `3a225f81f16e4cf2a1e62bbb3ec8eee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81577) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:31.120483 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-eda0ad46-6af8-4d38-8bdd-1de2608bcca4 None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:31.138674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 823/1652] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 21 01:15:31 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 128 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:31.166585 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887147f-e30e-4f7a-8bd8-fe00a06c69df None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:31.192502 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-0887147f-e30e-4f7a-8bd8-fe00a06c69df None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:31.201941 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-3ca5bdbe-3293-4551-8c0c-e7e1818e3f95 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a225f81f16e4cf2a1e62bbb3ec8eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:31.203236 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5bdbe-3293-4551-8c0c-e7e1818e3f95 service placement] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:31.203807 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5bdbe-3293-4551-8c0c-e7e1818e3f95 service placement] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:31.204394 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-3ca5bdbe-3293-4551-8c0c-e7e1818e3f95 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:31.222536 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5bdbe-3293-4551-8c0c-e7e1818e3f95 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:31.225928 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-3ca5bdbe-3293-4551-8c0c-e7e1818e3f95 service placement] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:31.246232 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 830/1653] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:31 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 81 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:15:37.328695 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18a232-c26f-4476-8c68-bb863fe17dc9 None None] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:37.329563 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18a232-c26f-4476-8c68-bb863fe17dc9 None None] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:37.329759 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-eb18a232-c26f-4476-8c68-bb863fe17dc9 None None] PATH_INFO: `/` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:37.331435 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 824/1654] 10.222.0.49 () {54 vars in 921 bytes} [Sun Aug 21 01:15:37 2022] GET /identity => generated 270 bytes in 4 msecs (HTTP/1.1 300) 6 headers in 234 bytes (2 switches on core 0) Aug 21 01:15:37.348486 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e01479-b8f4-4d3c-ac86-c3e6236d0a9b None None] REQUEST_METHOD: `POST` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:37.349319 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e01479-b8f4-4d3c-ac86-c3e6236d0a9b None None] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:37.349941 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-19e01479-b8f4-4d3c-ac86-c3e6236d0a9b None None] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:37.386363 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.auth.core [None req-19e01479-b8f4-4d3c-ac86-c3e6236d0a9b None None] MFA Rules not processed for user `3a225f81f16e4cf2a1e62bbb3ec8eee0`. Rule list: `[]` (Enabled: `True`). {{(pid=81578) check_auth_methods_against_rules /opt/stack/keystone/keystone/auth/core.py:438}} Aug 21 01:15:37.388180 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-19e01479-b8f4-4d3c-ac86-c3e6236d0a9b None None] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:37.402421 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 831/1655] 10.222.0.49 () {58 vars in 1018 bytes} [Sun Aug 21 01:15:37 2022] POST /identity/v3/auth/tokens => generated 3308 bytes in 55 msecs (HTTP/1.1 201) 6 headers in 385 bytes (1 switches on core 0) Aug 21 01:15:37.427237 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18a232-c26f-4476-8c68-bb863fe17dc9 None None] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:37.448645 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e01479-b8f4-4d3c-ac86-c3e6236d0a9b None None] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:37.451279 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-eb18a232-c26f-4476-8c68-bb863fe17dc9 None None] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:37.459836 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd027e8-43f4-4ed6-85b6-fa0c17a9ce09 service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a225f81f16e4cf2a1e62bbb3ec8eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:37.460679 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd027e8-43f4-4ed6-85b6-fa0c17a9ce09 service placement] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:37.461162 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd027e8-43f4-4ed6-85b6-fa0c17a9ce09 service placement] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:37.461608 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7bd027e8-43f4-4ed6-85b6-fa0c17a9ce09 service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:37.468147 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-19e01479-b8f4-4d3c-ac86-c3e6236d0a9b None None] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:37.478075 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd027e8-43f4-4ed6-85b6-fa0c17a9ce09 service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:37.481314 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7bd027e8-43f4-4ed6-85b6-fa0c17a9ce09 service placement] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:37.484259 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a3616-78a0-47cf-8f72-3d72d0f76d62 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:37.485875 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a3616-78a0-47cf-8f72-3d72d0f76d62 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:37.486665 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a3616-78a0-47cf-8f72-3d72d0f76d62 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:37.487325 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-811a3616-78a0-47cf-8f72-3d72d0f76d62 admin admin] PATH_INFO: `/v3/users/f599b0676c2241b88e7192223f5cee5b` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:37.489693 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a3616-78a0-47cf-8f72-3d72d0f76d62 admin admin] RBAC: Authorizing `identity:delete_user(user_id=f599b0676c2241b88e7192223f5cee5b)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:37.492897 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-811a3616-78a0-47cf-8f72-3d72d0f76d62 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:37.500191 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 825/1656] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:15:37 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 74 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:15:37.576928 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-811a3616-78a0-47cf-8f72-3d72d0f76d62 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'f599b0676c2241b88e7192223f5cee5b'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:37.590410 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-811a3616-78a0-47cf-8f72-3d72d0f76d62 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'f599b0676c2241b88e7192223f5cee5b'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:37.591356 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-811a3616-78a0-47cf-8f72-3d72d0f76d62 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'f599b0676c2241b88e7192223f5cee5b'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:37.601967 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-811a3616-78a0-47cf-8f72-3d72d0f76d62 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'f599b0676c2241b88e7192223f5cee5b'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:37.619805 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-811a3616-78a0-47cf-8f72-3d72d0f76d62 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'f599b0676c2241b88e7192223f5cee5b'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:37.627697 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 832/1657] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:37 2022] DELETE /identity/v3/users/f599b0676c2241b88e7192223f5cee5b => generated 0 bytes in 180 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:15:37.875918 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd027e8-43f4-4ed6-85b6-fa0c17a9ce09 service placement] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:37.890563 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7bd027e8-43f4-4ed6-85b6-fa0c17a9ce09 service placement] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:37.998086 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98c1c3-f8fa-494a-a1f4-2f096de3c508 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:37.999006 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98c1c3-f8fa-494a-a1f4-2f096de3c508 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:37.999451 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98c1c3-f8fa-494a-a1f4-2f096de3c508 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:37.999912 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-ed98c1c3-f8fa-494a-a1f4-2f096de3c508 admin admin] PATH_INFO: `/v3/projects/11f9354b5a54458086eafbe74b85b744` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:38.001752 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98c1c3-f8fa-494a-a1f4-2f096de3c508 admin admin] RBAC: Authorizing `identity:delete_project(project_id=11f9354b5a54458086eafbe74b85b744)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:38.004039 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-ed98c1c3-f8fa-494a-a1f4-2f096de3c508 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:38.063292 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-ed98c1c3-f8fa-494a-a1f4-2f096de3c508 admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '11f9354b5a54458086eafbe74b85b744', 'request_id': 'req-ed98c1c3-f8fa-494a-a1f4-2f096de3c508'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:38.074985 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-ed98c1c3-f8fa-494a-a1f4-2f096de3c508 admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '11f9354b5a54458086eafbe74b85b744', 'request_id': 'req-ed98c1c3-f8fa-494a-a1f4-2f096de3c508'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:38.088155 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-ed98c1c3-f8fa-494a-a1f4-2f096de3c508 admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '11f9354b5a54458086eafbe74b85b744', 'request_id': 'req-ed98c1c3-f8fa-494a-a1f4-2f096de3c508'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:38.126481 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-ed98c1c3-f8fa-494a-a1f4-2f096de3c508 admin admin] The token cache is being invalidate because project 11f9354b5a54458086eafbe74b85b744 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:38.126981 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-ed98c1c3-f8fa-494a-a1f4-2f096de3c508 admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:38.131027 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-ed98c1c3-f8fa-494a-a1f4-2f096de3c508 admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:38.136796 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 826/1658] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:37 2022] DELETE /identity/v3/projects/11f9354b5a54458086eafbe74b85b744 => generated 0 bytes in 263 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:38.142371 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a3616-78a0-47cf-8f72-3d72d0f76d62 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:38.143943 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-811a3616-78a0-47cf-8f72-3d72d0f76d62 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:38.157823 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-811a3616-78a0-47cf-8f72-3d72d0f76d62 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:38.161866 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=89,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:38.237312 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ade757-9373-4e41-868e-e7cb63df5028 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:38.238129 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ade757-9373-4e41-868e-e7cb63df5028 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:38.238468 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ade757-9373-4e41-868e-e7cb63df5028 admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:38.238783 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-80ade757-9373-4e41-868e-e7cb63df5028 admin admin] PATH_INFO: `/v3/users/059979620bca4d1284a8070c81616429` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:38.240210 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ade757-9373-4e41-868e-e7cb63df5028 admin admin] RBAC: Authorizing `identity:delete_user(user_id=059979620bca4d1284a8070c81616429)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:38.242369 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-80ade757-9373-4e41-868e-e7cb63df5028 admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:38.302857 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-80ade757-9373-4e41-868e-e7cb63df5028 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '059979620bca4d1284a8070c81616429'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:38.310971 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-80ade757-9373-4e41-868e-e7cb63df5028 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '059979620bca4d1284a8070c81616429'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:38.311820 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-80ade757-9373-4e41-868e-e7cb63df5028 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '059979620bca4d1284a8070c81616429'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:38.321623 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-80ade757-9373-4e41-868e-e7cb63df5028 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '059979620bca4d1284a8070c81616429'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:38.337090 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-80ade757-9373-4e41-868e-e7cb63df5028 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '059979620bca4d1284a8070c81616429'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:38.343887 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 833/1659] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 21 01:15:38 2022] DELETE /identity/v3/users/059979620bca4d1284a8070c81616429 => generated 0 bytes in 202 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:38.613084 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98c1c3-f8fa-494a-a1f4-2f096de3c508 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:15:38.615558 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-ed98c1c3-f8fa-494a-a1f4-2f096de3c508 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:15:38.639408 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-ed98c1c3-f8fa-494a-a1f4-2f096de3c508 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:15:38.660958 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:38.750602 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b33aa9-4a28-429a-9ec7-337bc6b33b2e admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:15:38.751641 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b33aa9-4a28-429a-9ec7-337bc6b33b2e admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:15:38.752061 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b33aa9-4a28-429a-9ec7-337bc6b33b2e admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:15:38.752604 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-97b33aa9-4a28-429a-9ec7-337bc6b33b2e admin admin] PATH_INFO: `/v3/projects/5406cbb1ecd74e7c9cb89e3ad19d3ace` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:15:38.754958 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b33aa9-4a28-429a-9ec7-337bc6b33b2e admin admin] RBAC: Authorizing `identity:delete_project(project_id=5406cbb1ecd74e7c9cb89e3ad19d3ace)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:15:38.758696 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-97b33aa9-4a28-429a-9ec7-337bc6b33b2e admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:15:38.836791 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-97b33aa9-4a28-429a-9ec7-337bc6b33b2e admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '5406cbb1ecd74e7c9cb89e3ad19d3ace', 'request_id': 'req-97b33aa9-4a28-429a-9ec7-337bc6b33b2e'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:38.848870 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-97b33aa9-4a28-429a-9ec7-337bc6b33b2e admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '5406cbb1ecd74e7c9cb89e3ad19d3ace', 'request_id': 'req-97b33aa9-4a28-429a-9ec7-337bc6b33b2e'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:38.861549 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-97b33aa9-4a28-429a-9ec7-337bc6b33b2e admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '5406cbb1ecd74e7c9cb89e3ad19d3ace', 'request_id': 'req-97b33aa9-4a28-429a-9ec7-337bc6b33b2e'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:38.883865 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-97b33aa9-4a28-429a-9ec7-337bc6b33b2e admin admin] The token cache is being invalidate because project 5406cbb1ecd74e7c9cb89e3ad19d3ace was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81577) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:15:38.884361 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-97b33aa9-4a28-429a-9ec7-337bc6b33b2e admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:38.885482 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-97b33aa9-4a28-429a-9ec7-337bc6b33b2e admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:15:38.888071 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 827/1660] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 21 01:15:38 2022] DELETE /identity/v3/projects/5406cbb1ecd74e7c9cb89e3ad19d3ace => generated 0 bytes in 276 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:15:48.339924 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=50,keystone:DELETE=10,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:15:48.877669 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=46,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:23.362764 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ade757-9373-4e41-868e-e7cb63df5028 admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:23.364298 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-80ade757-9373-4e41-868e-e7cb63df5028 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:23.480509 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-80ade757-9373-4e41-868e-e7cb63df5028 admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:23.484138 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b33aa9-4a28-429a-9ec7-337bc6b33b2e admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:23.486643 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-97b33aa9-4a28-429a-9ec7-337bc6b33b2e admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:23.578723 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b000f5-432a-43c4-9446-e13835be02f5 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:23.578999 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-97b33aa9-4a28-429a-9ec7-337bc6b33b2e admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:23.579134 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b000f5-432a-43c4-9446-e13835be02f5 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:23.579134 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b000f5-432a-43c4-9446-e13835be02f5 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:23.579134 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-11b000f5-432a-43c4-9446-e13835be02f5 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:23.582491 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-11b000f5-432a-43c4-9446-e13835be02f5 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:23.585293 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b14ac4-c44c-4668-b104-4cf4f972a83a service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:23.585969 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b14ac4-c44c-4668-b104-4cf4f972a83a service neutron] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:23.586255 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b14ac4-c44c-4668-b104-4cf4f972a83a service neutron] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:23.586530 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-96b14ac4-c44c-4668-b104-4cf4f972a83a service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:23.588642 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-96b14ac4-c44c-4668-b104-4cf4f972a83a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:23.603199 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b000f5-432a-43c4-9446-e13835be02f5 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:23.606635 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-11b000f5-432a-43c4-9446-e13835be02f5 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:23.629470 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 834/1661] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:23 2022] GET /identity/v3/auth/tokens => generated 3121 bytes in 267 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:23.726283 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b14ac4-c44c-4668-b104-4cf4f972a83a service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:23.728888 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-96b14ac4-c44c-4668-b104-4cf4f972a83a service neutron] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:23.765740 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 828/1662] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:23 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 283 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:17:25.023183 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b000f5-432a-43c4-9446-e13835be02f5 service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:25.033069 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-11b000f5-432a-43c4-9446-e13835be02f5 service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:25.037154 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ed30b-d990-4219-a752-fb5491095f42 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:25.037769 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ed30b-d990-4219-a752-fb5491095f42 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:25.038039 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ed30b-d990-4219-a752-fb5491095f42 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:25.038305 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fd3ed30b-d990-4219-a752-fb5491095f42 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:25.040317 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-fd3ed30b-d990-4219-a752-fb5491095f42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:25.054808 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ed30b-d990-4219-a752-fb5491095f42 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:25.056287 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fd3ed30b-d990-4219-a752-fb5491095f42 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:25.067910 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 835/1663] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:25 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 45 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:30.623787 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b14ac4-c44c-4668-b104-4cf4f972a83a service neutron] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:30.625292 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-96b14ac4-c44c-4668-b104-4cf4f972a83a service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:30.639474 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-96b14ac4-c44c-4668-b104-4cf4f972a83a service neutron] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:30.649195 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da5d8a-8ea1-4f5e-985a-64ef33d2c9b8 service nova] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '6b003ae4a082485ab608bf84c1657159', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'ResellerAdmin', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:30.649653 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da5d8a-8ea1-4f5e-985a-64ef33d2c9b8 service nova] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:30.649933 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da5d8a-8ea1-4f5e-985a-64ef33d2c9b8 service nova] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:30.650196 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-26da5d8a-8ea1-4f5e-985a-64ef33d2c9b8 service nova] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:30.652128 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-26da5d8a-8ea1-4f5e-985a-64ef33d2c9b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:30.668150 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da5d8a-8ea1-4f5e-985a-64ef33d2c9b8 service nova] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:30.669927 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-26da5d8a-8ea1-4f5e-985a-64ef33d2c9b8 service nova] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:30.683047 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 829/1664] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:30 2022] GET /identity/v3/auth/tokens => generated 3372 bytes in 60 msecs (HTTP/1.1 200) 6 headers in 380 bytes (2 switches on core 0) Aug 21 01:17:35.063016 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=52 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:36.295128 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ed30b-d990-4219-a752-fb5491095f42 service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:36.296578 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-fd3ed30b-d990-4219-a752-fb5491095f42 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:36.307514 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fd3ed30b-d990-4219-a752-fb5491095f42 service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:36.311802 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f437702-fcfe-4818-b9ad-396c717413e2 service neutron] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '78c29816db2d4193b293a0f94b4d1a01', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['service'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:36.312483 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f437702-fcfe-4818-b9ad-396c717413e2 service neutron] REQUEST_METHOD: `GET` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:36.312694 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f437702-fcfe-4818-b9ad-396c717413e2 service neutron] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:36.312982 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-7f437702-fcfe-4818-b9ad-396c717413e2 service neutron] PATH_INFO: `/v3/auth/tokens` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:36.315008 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-7f437702-fcfe-4818-b9ad-396c717413e2 service neutron] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:36.381384 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f437702-fcfe-4818-b9ad-396c717413e2 service neutron] RBAC: Authorizing `identity:validate_token()` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:36.382844 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-7f437702-fcfe-4818-b9ad-396c717413e2 service neutron] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:36.392707 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 836/1665] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:17:36 2022] GET /identity/v3/auth/tokens => generated 3239 bytes in 98 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:17:40.678475 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=69 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:43.021872 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da5d8a-8ea1-4f5e-985a-64ef33d2c9b8 service nova] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:43.023432 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-26da5d8a-8ea1-4f5e-985a-64ef33d2c9b8 service nova] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:43.037270 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-26da5d8a-8ea1-4f5e-985a-64ef33d2c9b8 service nova] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:43.042289 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24314e-3f9b-4d9f-8485-58811c188fbe admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:43.042930 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24314e-3f9b-4d9f-8485-58811c188fbe admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:43.043210 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24314e-3f9b-4d9f-8485-58811c188fbe admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:43.043484 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-fe24314e-3f9b-4d9f-8485-58811c188fbe admin admin] PATH_INFO: `/v3/users/41864937ad9d47688b054e39744cd180` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:43.059322 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24314e-3f9b-4d9f-8485-58811c188fbe admin admin] RBAC: Authorizing `identity:delete_user(user_id=41864937ad9d47688b054e39744cd180)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:43.060361 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: WARNING py.warnings [None req-fe24314e-3f9b-4d9f-8485-58811c188fbe admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_user": "(role:admin and system_scope:all) or (role:admin and token.domain.id:%(target.user.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:17:43.060361 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: warnings.warn(msg) Aug 21 01:17:43.060361 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: Aug 21 01:17:43.061644 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-fe24314e-3f9b-4d9f-8485-58811c188fbe admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:43.124825 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-fe24314e-3f9b-4d9f-8485-58811c188fbe admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': '41864937ad9d47688b054e39744cd180'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:43.125504 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-fe24314e-3f9b-4d9f-8485-58811c188fbe admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': '41864937ad9d47688b054e39744cd180'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:43.126201 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-fe24314e-3f9b-4d9f-8485-58811c188fbe admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': '41864937ad9d47688b054e39744cd180'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:43.135026 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-fe24314e-3f9b-4d9f-8485-58811c188fbe admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': '41864937ad9d47688b054e39744cd180'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:43.145078 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-fe24314e-3f9b-4d9f-8485-58811c188fbe admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': '41864937ad9d47688b054e39744cd180'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:43.171108 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 830/1666] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 21 01:17:43 2022] DELETE /identity/v3/users/41864937ad9d47688b054e39744cd180 => generated 0 bytes in 150 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:43.385311 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f437702-fcfe-4818-b9ad-396c717413e2 service neutron] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:43.397237 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-7f437702-fcfe-4818-b9ad-396c717413e2 service neutron] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:43.469860 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c0c99-5e26-47c2-9e31-63058daff6fb admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:43.470918 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c0c99-5e26-47c2-9e31-63058daff6fb admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:43.471361 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c0c99-5e26-47c2-9e31-63058daff6fb admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:43.471718 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-223c0c99-5e26-47c2-9e31-63058daff6fb admin admin] PATH_INFO: `/v3/projects/bf67ac1745584a51bd12525ecd676221` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:43.490356 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c0c99-5e26-47c2-9e31-63058daff6fb admin admin] RBAC: Authorizing `identity:delete_project(project_id=bf67ac1745584a51bd12525ecd676221)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:43.491447 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: WARNING py.warnings [None req-223c0c99-5e26-47c2-9e31-63058daff6fb admin admin] /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "identity:delete_project": "(role:admin and system_scope:all) or (role:admin and domain_id:%(target.project.domain_id)s)" failed scope check. The token used to make the request was project scoped but the policy requires ['system', 'domain'] scope. This behavior may change in the future where using the intended scope is required Aug 21 01:17:43.491447 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: warnings.warn(msg) Aug 21 01:17:43.491447 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: Aug 21 01:17:43.492725 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-223c0c99-5e26-47c2-9e31-63058daff6fb admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:43.559764 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-223c0c99-5e26-47c2-9e31-63058daff6fb admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': 'bf67ac1745584a51bd12525ecd676221', 'request_id': 'req-223c0c99-5e26-47c2-9e31-63058daff6fb'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:43.567428 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-223c0c99-5e26-47c2-9e31-63058daff6fb admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': 'bf67ac1745584a51bd12525ecd676221', 'request_id': 'req-223c0c99-5e26-47c2-9e31-63058daff6fb'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:43.577911 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-223c0c99-5e26-47c2-9e31-63058daff6fb admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': 'bf67ac1745584a51bd12525ecd676221', 'request_id': 'req-223c0c99-5e26-47c2-9e31-63058daff6fb'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:43.609329 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-223c0c99-5e26-47c2-9e31-63058daff6fb admin admin] The token cache is being invalidate because project bf67ac1745584a51bd12525ecd676221 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:17:43.609625 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-223c0c99-5e26-47c2-9e31-63058daff6fb admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:43.610309 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-223c0c99-5e26-47c2-9e31-63058daff6fb admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:43.612145 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 837/1667] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 21 01:17:43 2022] DELETE /identity/v3/projects/bf67ac1745584a51bd12525ecd676221 => generated 0 bytes in 228 msecs (HTTP/1.1 204) 3 headers in 132 bytes (1 switches on core 0) Aug 21 01:17:43.617809 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24314e-3f9b-4d9f-8485-58811c188fbe admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:43.619983 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-fe24314e-3f9b-4d9f-8485-58811c188fbe admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:43.633728 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-fe24314e-3f9b-4d9f-8485-58811c188fbe admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:43.701842 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011052e2-aba2-4f95-bf4f-dc58a5e40e22 admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:43.702513 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011052e2-aba2-4f95-bf4f-dc58a5e40e22 admin admin] REQUEST_METHOD: `DELETE` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:43.702799 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011052e2-aba2-4f95-bf4f-dc58a5e40e22 admin admin] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:43.703166 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-011052e2-aba2-4f95-bf4f-dc58a5e40e22 admin admin] PATH_INFO: `/v3/users/ed2c646eb90743e0bf3cc427d28f0d72` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:43.719219 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011052e2-aba2-4f95-bf4f-dc58a5e40e22 admin admin] RBAC: Authorizing `identity:delete_user(user_id=ed2c646eb90743e0bf3cc427d28f0d72)` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:43.721220 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-011052e2-aba2-4f95-bf4f-dc58a5e40e22 admin admin] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:43.778525 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-011052e2-aba2-4f95-bf4f-dc58a5e40e22 admin admin] Invoking callback _drop_receipt_cache for event identity user deleted for {'resource_info': 'ed2c646eb90743e0bf3cc427d28f0d72'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:43.779535 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-011052e2-aba2-4f95-bf4f-dc58a5e40e22 admin admin] Invoking callback _drop_token_cache for event identity user deleted for {'resource_info': 'ed2c646eb90743e0bf3cc427d28f0d72'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:43.780395 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-011052e2-aba2-4f95-bf4f-dc58a5e40e22 admin admin] Invoking callback _user_callback for event identity user deleted for {'resource_info': 'ed2c646eb90743e0bf3cc427d28f0d72'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:43.785424 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=80,keystone:DELETE=18,keystone:INSERT=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:43.791468 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-011052e2-aba2-4f95-bf4f-dc58a5e40e22 admin admin] Invoking callback _on_user_delete for event identity user deleted for {'resource_info': 'ed2c646eb90743e0bf3cc427d28f0d72'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:43.800687 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.notifications [None req-011052e2-aba2-4f95-bf4f-dc58a5e40e22 admin admin] Invoking callback _delete_app_creds_on_user_delete_callback for event identity user deleted for {'resource_info': 'ed2c646eb90743e0bf3cc427d28f0d72'} {{(pid=81577) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:43.820417 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 831/1668] 10.222.0.49 () {58 vars in 1224 bytes} [Sun Aug 21 01:17:43 2022] DELETE /identity/v3/users/ed2c646eb90743e0bf3cc427d28f0d72 => generated 0 bytes in 204 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:44.026197 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c0c99-5e26-47c2-9e31-63058daff6fb admin admin] Authenticating user token {{(pid=81578) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:17:44.027737 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.fernet_utils [None req-223c0c99-5e26-47c2-9e31-63058daff6fb admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81578) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:17:44.041520 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-223c0c99-5e26-47c2-9e31-63058daff6fb admin admin] Validating token access rules against request {{(pid=81578) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:17:44.054200 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=92,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:44.102037 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-be3102a3-1e21-44e9-95ef-23638829250c admin admin] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': 'bab4a9bddb7141a48bb694677f33efcc', 'user_domain_id': 'default', 'system_scope': None, 'project_id': 'ccef469c265b41be893535a3cf96c82d', 'project_domain_id': 'default', 'roles': ['admin', 'member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81578) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:17:44.102678 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3102a3-1e21-44e9-95ef-23638829250c admin admin] REQUEST_METHOD: `DELETE` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:17:44.102949 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3102a3-1e21-44e9-95ef-23638829250c admin admin] SCRIPT_NAME: `/identity` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:17:44.103213 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.server.flask.request_processing.req_logging [None req-be3102a3-1e21-44e9-95ef-23638829250c admin admin] PATH_INFO: `/v3/projects/96a839777ead420ea7022c98c627d538` {{(pid=81578) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:17:44.119693 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3102a3-1e21-44e9-95ef-23638829250c admin admin] RBAC: Authorizing `identity:delete_project(project_id=96a839777ead420ea7022c98c627d538)` {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:17:44.121683 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-be3102a3-1e21-44e9-95ef-23638829250c admin admin] RBAC: Authorization granted {{(pid=81578) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:17:44.190380 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-be3102a3-1e21-44e9-95ef-23638829250c admin admin] Invoking callback _on_project_or_endpoint_delete for event identity project deleted for {'resource_info': '96a839777ead420ea7022c98c627d538', 'request_id': 'req-be3102a3-1e21-44e9-95ef-23638829250c'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:44.196017 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-be3102a3-1e21-44e9-95ef-23638829250c admin admin] Invoking callback _project_callback for event identity project deleted for {'resource_info': '96a839777ead420ea7022c98c627d538', 'request_id': 'req-be3102a3-1e21-44e9-95ef-23638829250c'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:44.205733 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-be3102a3-1e21-44e9-95ef-23638829250c admin admin] Invoking callback _unset_default_project for event identity project deleted for {'resource_info': '96a839777ead420ea7022c98c627d538', 'request_id': 'req-be3102a3-1e21-44e9-95ef-23638829250c'} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:44.217684 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-be3102a3-1e21-44e9-95ef-23638829250c admin admin] The token cache is being invalidate because project 96a839777ead420ea7022c98c627d538 was deleted. Authorization will be recalculated and enforced accordingly the next time users authenticate or validate a token. {{(pid=81578) invalidate_token_cache_notification /opt/stack/keystone/keystone/notifications.py:230}} Aug 21 01:17:44.217967 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-be3102a3-1e21-44e9-95ef-23638829250c admin admin] Invoking callback _drop_token_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:44.218653 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG keystone.notifications [None req-be3102a3-1e21-44e9-95ef-23638829250c admin admin] Invoking callback _drop_receipt_cache for event identity invalidate_token_cache internal for {'resource_info': None} {{(pid=81578) notify_event_callbacks /opt/stack/keystone/keystone/notifications.py:355}} Aug 21 01:17:44.220177 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: [pid: 81578|app: 0|req: 838/1669] 10.222.0.49 () {58 vars in 1233 bytes} [Sun Aug 21 01:17:44 2022] DELETE /identity/v3/projects/96a839777ead420ea7022c98c627d538 => generated 0 bytes in 195 msecs (HTTP/1.1 204) 3 headers in 132 bytes (0 switches on core 0) Aug 21 01:17:53.816568 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=12,keystone:DELETE=2 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:17:54.214563 dv-osbrick-master-4-iscsi devstack@keystone.service[81578]: DEBUG dbcounter [-] [81578] Writing DB stats keystone:SELECT=48,keystone:DELETE=7,keystone:INSERT=1 {{(pid=81578) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Aug 21 01:20:43.573438 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011052e2-aba2-4f95-bf4f-dc58a5e40e22 admin admin] Authenticating user token {{(pid=81577) process_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:407}} Aug 21 01:20:43.576346 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-011052e2-aba2-4f95-bf4f-dc58a5e40e22 admin admin] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:43.677661 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-011052e2-aba2-4f95-bf4f-dc58a5e40e22 admin admin] Validating token access rules against request {{(pid=81577) validate_allowed_request /usr/local/lib/python3.8/dist-packages/keystonemiddleware/auth_token/__init__.py:545}} Aug 21 01:20:43.754676 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.middleware.auth_context [None req-a7febc4f-2609-4586-b0a4-5df5caaaf05e service placement] RBAC: auth_context: {'token': , 'domain_id': None, 'trust_id': None, 'trustor_id': None, 'trustee_id': None, 'domain_name': None, 'group_ids': [], 'user_id': '3a225f81f16e4cf2a1e62bbb3ec8eee0', 'user_domain_id': 'default', 'system_scope': None, 'project_id': '838e996d09a0454b9bcdc5aef03ef203', 'project_domain_id': 'default', 'roles': ['admin', 'service', 'reader', 'member'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=81577) fill_context /opt/stack/keystone/keystone/server/flask/request_processing/middleware/auth_context.py:478}} Aug 21 01:20:43.755334 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7febc4f-2609-4586-b0a4-5df5caaaf05e service placement] REQUEST_METHOD: `GET` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:27}} Aug 21 01:20:43.755614 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7febc4f-2609-4586-b0a4-5df5caaaf05e service placement] SCRIPT_NAME: `/identity` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:28}} Aug 21 01:20:43.755883 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.server.flask.request_processing.req_logging [None req-a7febc4f-2609-4586-b0a4-5df5caaaf05e service placement] PATH_INFO: `/v3/auth/tokens` {{(pid=81577) log_request_info /opt/stack/keystone/keystone/server/flask/request_processing/req_logging.py:29}} Aug 21 01:20:43.757753 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.fernet_utils [None req-a7febc4f-2609-4586-b0a4-5df5caaaf05e service placement] Loaded 2 Fernet keys from /etc/keystone/fernet-keys/, but `[fernet_tokens] max_active_keys = 3`; perhaps there have not been enough key rotations to reach `max_active_keys` yet? {{(pid=81577) load_keys /opt/stack/keystone/keystone/common/fernet_utils.py:286}} Aug 21 01:20:43.769609 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7febc4f-2609-4586-b0a4-5df5caaaf05e service placement] RBAC: Authorizing `identity:validate_token()` {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:449}} Aug 21 01:20:43.771214 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG keystone.common.rbac_enforcer.enforcer [None req-a7febc4f-2609-4586-b0a4-5df5caaaf05e service placement] RBAC: Authorization granted {{(pid=81577) enforce_call /opt/stack/keystone/keystone/common/rbac_enforcer/enforcer.py:457}} Aug 21 01:20:43.781674 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: [pid: 81577|app: 0|req: 832/1670] 10.222.0.49 () {60 vars in 1365 bytes} [Sun Aug 21 01:20:43 2022] GET /identity/v3/auth/tokens => generated 3308 bytes in 209 msecs (HTTP/1.1 200) 6 headers in 380 bytes (1 switches on core 0) Aug 21 01:20:53.777321 dv-osbrick-master-4-iscsi devstack@keystone.service[81577]: DEBUG dbcounter [-] [81577] Writing DB stats keystone:SELECT=58 {{(pid=81577) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}}